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ABSTRACT 
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Analysis  of  Flow  Behavior  Within  an  Integrated 
Computer-Communication  Network.  (May  1979) 

Carroll  Ardee  Clabaugh,  B.A.,  Coe  College; 

M.S.,  New  Mexico  State  University 
Chairman  of  Advisory  Committee:  Dr.  Udo  Pooch 

-This  research  concerns  itself  with  the  flow  behavior 
in  a  computer-communication  network  that  integrates  data 
and  voice  classes  of  traffic.  This  behavior  is  analyzed 
as  a  queueing  problem  by  modeling  nodes  and  channels  and 
evaluating  their  behavior  under  different  arrival  rates. 

Switching  mechanisms,  flow  control  considerations, 
and  the  development  and  use  of  simulation  and  analytical 
models  are  emphasized. 

Prominent  flow  control  strategies  are  classified  into 
a  framework  for  potential  utility  as  regulating  controls 
in  an  integrated  environment. 

An  event-driven  FORTRAN  network  simulator  is  developed 
based  on  common  call  management,  traffic  integration  on 
trunk  lines,  and  an  underlying  circuit  switched  communica¬ 
tions  subnet.  The  network  simulator  is  a  cost-effective 
portable  tool  that  has  application  in  an  environment  where 
computer  resources  are  limited.  It  is  sufficiently  general 
in  structure  so  that  several  design  factors  can  be  varied 
by  the  user  to  evaluate  network  performance  by  collecting 
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appropriate  empirical  data. 

'An  algorithm  is  formulated  that  permits  decomposition 
of  the  network  into  nodal  configurations.  A  FORTRAN  program 
is  developed  that  implements  this  algorithm..  —  ....  .  ... 

Finally,  summary  information  demonstrates  the  practi¬ 
cality  of  an  integrated  network  and  need  for  flow  controls. 
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ABSTRACT 


Analysis  of  Flow  Behavior  Within  an  Integrated 
Computer-Communication  Network.  (May  1979) 

Carroll  Ardee  Clabaugh,  B.A.,  Coe  College; 

M.S.,  New  Mexico  State  University 
Chairman  of  Advisory  Committee:  Dr.  Udo  Pooch 

This  research  concerns  itself  with  the  flow  behavior 
in  a  computer-communication  network  that  integrates  data 
and  voice  classes  of  traffic.  This  behavior  is  analyzed 
as  a  queueing  problem  by  modeling  nodes  and  channels  and 
evaluating  their  behavior  under  different  arrival  rates. 

Switching  mechanisms,  flow  control  considerations, 
and  the  development  and  use  of  simulation  and  analytical 
models  are  emphasized. 

Prominent  flow  control  strategies  are  classified  into 
a  framework  for  potential  utility  as  regulating  controls 
in  an  integrated  environment. 

An  event-driven  FORTRAN  network  simulator  is  developed 
based  on  common  call  management,  traffic  integration  on 
trunk  lines,  and  an  underlying  circuit  switched  communica¬ 
tions  subnet.  The  network  simulator  is  a  cost-effective 
portable  tool  that  has  application  in  an  environment  where 
computer  resources  are  limited.  It  is  sufficiently  general 
in  structure  so  that  several  design  factors  can  be  varied 
by  the  user  to  evaluate  network  performance  by  collecting 


appropriate  empirical  data. 

An  algorithm  is  formulated  that  permits  decomposition 
of  the  network  into  nodal  configurations.  A  FORTRAN  program 
is  developed  that  implements  this  algorithm. 

Finally,  summary  information  demonstrates  the  practi¬ 
cality  of  an  integrated  network  and  need  for  flow  controls. 


ACKNOWLEDGEMENTS 


I  an  nost  appreciative  of  the  support,  direction,  and 
constructive  criticism  provided  by  my  chairman,  Dr.  L do 
Pocch,  throughout  m>  research  effort.  Ei  i  s  professional 
assistance  has  contributed  greatly  to  timely  completion  of 
this  dissertation.  Also,  much  gratitude  is  due  Drs . 

Richard  Feldman  and  Stephen  Jones  for  their  assistance  in  the 
development  of  a  queueing  model  for  an  integrated 
communications  node. 

Particular  thanks  are  due  my  wife,  Joyce,  who  typed 
my  dissertation  and  assisted  me  throughout  my  effort. 


TABLE  OF  CONTENTS 


Page 

ABSTRACT . iii 

ACKNOWLEDGEMENTS . v 

DEDICATION . vi 

TABLE  OF  CONTENTS . vii 

LIST  OF  FIGURES . xi 

LIST  OF  TABLES . xii 

Chapter 


I.  INTRODUCTION 


1.  Computer-Communications  Networking . i 

1.1  Evolutionary  Development . 2 

1.2  The  Case  for  an  Integrated  Pa cket/C i rcu i t 

Switch  Network . 3 

1.3  Research  Objectives  and  Plans . 4 

II.  LITERATURE  SURVEY . 8 

2  .  Ove  rvi  ew . 8 

2.1  Network  Design  Areas . 8 

2.1.1  Integration  Methodology . 9 

2.1.2  Line  Switching . 12 

2.1.3  Routing . 15 

2.1.4  Flow  Control . 16 

2.1.5  Nodal  Desi  gn . 18 

2. 1.5.1  Circuit  Switch  Archi  tecture . .  1  8 

2. 1.5. 2  Packet  Switch  Archi tecture ...  22 

2.1.6  P  r  i  o  r  i  ty  /  P  reemp  t  i  on  Controls . 24 

III.  FLOW  CONTROLS  IN  DISTRIBUTED  COMPUTER- 

COMMUNICATION  NETWORKS . 26 

3.  Problem  Definition . 26 

3.1  Structural  Flow  Control  Layers . 27 

3.2  Overview  of  a  Flow  Control  Strategy . 29 

3.3  Objectives  of  a  Flow  Control  Strategy . 30 

3.3.1  Congestion  Prevention . 30 

3.3.2  Deadlock  Prevention . 30 

3.3.3  End-to-End  Flow  Control . 30 


VI  1  1 


Page 

3.3.4  Fair  Allocation  of  Communication 

Resources . 31 

3.4  Flow  Control  Strategies . 31 

3.4.1  Subnet  Controlling . 31 

3. 4. 1.1  Isarithmic . 33 

3. 4. 1.2  Centralized  Flow  Control 

Station . 34 

3. 4. 1.3  Flow  Control  Tables . 35 

3. 4. 1.4  Nodal  Buffer  Monopoly . 36 

3. 4. 1.5  Overflow  Detection . 38 

3. 4. 1.6  Nodal  Limits . 39 

3. 4. 1.7  Node-Node  ARQ  (Automatic 

Request  for  Repeat) . 39 

3. 4. 1.8  Dedicated  Nodal  Buffers . 40 

3.4.2  Subscriber  Controlling . 40 

3.4.2. 1  Reservation  Schemes . 41 

3. 4. 2. 2  Crate  Occupancy . 43 

3. 4. 2. 3  Subscriber-Subscriber . 44 

3.5  Conclusions . 46 

IV.  THE  NETWORK  SIMULATION  MODEL . 48 

4  .  Introduction . 48 

4.1  Description  of  the  Queueing  Model . 54 

4.2  Overview  of  the  Simulator . 56 

4.3  Properties  of  the  Model . 60 

4.3.1  Operating  Characteristics . 60 

4.3.2  Description  of  Functional  Modules . 60 

4. 3. 2.1  Initialization . 61 

4. 3. 2. 2  Transaction  Generation . 61 

4. 3. 2. 3  Arrival . 61 

4. 3. 2. 4  Routing . 62 

4. 3. 2. 5  Departure . 63 

4. 3. 2. 6  Event  Selection . 63 

4. 3. 2. 7  Statistical  Gathering  and 

Output . 64 

4.4  Description  of  Major  Tables . 64 

V.  ANALYTIC  DEVELOPMENT  OF  AN  INTEGRATED  MODEL . 66 

•  5.  Introduction . 66 

5.1  Solution  Process . 69 

5.1.1  Algorithm  Development . 73 

5.1.2  Pq  Vector  Determination . 76 

5.1.3  Steady-State  P  Vector  Determi nati on  .  .  .  76 


i  x 


Page 

5.2  Determination  of  Effectiveness  Measures . 82 

5.3  Conclusions . 83 

VI.  DEVELOPMENT  OF  AN  INTEGRATED  FLOW  CONTROL  SCHEME.. 85 

6.  The  Need  For  a  Flow  Control  Scheme . 85 

6.1  Utility  of  Existing  Strategies . 85 

6.2  A  Ring  Control  Scheme  Proposal . 86 

6.2.1  Nodal  Limits  Ring . 88 

6.2.2  Nodal  Monopoly  Ring . 88 

6.2.3  Wi  ndow  Ring . 89 

6.3  Ring  Scheme  Implementation . 89 

6.3.1  Nodal  Limit  Variables . 90 

6.3.2  Global  Monopoly  Matrix . 90 

6.4  Subscriber  Window  Development . 90 

6.4.1  Multiple  Interrupt  Level  Capabi 1 i ty . . . 92 

6.4.2  Variable  I/O  Data  Rate  Termi na ti ons . . . 92 

6.5  Subscriber  Software  Development . 92 

VII.  ANALYSIS  OF  NETWORK  BEHAVIOR . 93 

7.  Network  Configuration . 93 

7.1  Examination  of  the  Simulator . 93 

7.1.2  Confidence  in  the  Simulator . 95 

7.1.3  Description  of  Simulator  Output . 100 

7.2  Analysis  of  Network  Flow . 100 

7.3  Analysis  of  Analytic  Output . 101 

7.3.1  Decomposition-Synthesis  Approach . 108 

7.3.2  Utility  of  the  Analytic  Model . 108 

7 . 4  Summa  ry . 109 

VIII.  CONCLUSIONS  AND  RECOMMENDATIONS . Ill 

8.  Conclusions . Ill 

8.1  Recommendations . 112 

REFERENCES . 114 

APPENDIX  A . 122 

APPENDIX  B . 177 

APPENDIX  C . 203 


APPENDIX  D 


216 


XI 


LIST  OF  FIGURES 


F i qure  Raqe 

1.  Allocation  schemes . 11 

2  .  PCM  switching . 14 

3.  Circuit  switch  T1  terminations . 20 

4.  Buffer  state  matrix . 37 

5.  Network  configuration . 49 

6.  Master  frame  clocking . 51 

7.  Network  nodal  model . 57 

8.  Rate  matrix  for  three  channel  system . 68 

9.  Rate  matrix  block  diagram . 70 

10.  Flow  control  ring  scheme . 87 

11.  Flow  control  monopoly  matrix . 91 

12.  10-Node  network  configuration . 94 

13.  10-Node  routing  table  initialization . 96 

14.  Input  parameters  and  specifications  for 

10-node  network . 97 

15.  Packet  delay . 102 

16.  Link  utilization . 103 

17.  Packet  throughput . 104 

18.  Class  I  blocking . 105 

19.  Calls  in  system . 106 

20.  Data  transactions  in  system . 107 

f 


i 

» 


I 


LIST  OF  TABLES 


x  i  i 


Table  Page 

I.  Classification  of  Flow  Control  Strategies . 32 

II.  Calculation  of  Confidence  Intervals . 99 

A2-1.  Parameter  (PARAM)  [X] . 126 

A2-2.  Event  (EVTBL)  [Node,  Entry] . 127 

A2-3  Destination  (DESTAB)  [Node,  Dest] . 128 

A2-4.  Channel  Table  ( CHANTB  )  [Channel,  Entry] . 129 

A2-5.  Queue  (QUEUE)  [Node,  Entry] . 130 

A2-6.  Call  Queue  (CALLQ)  [Knode,  Entry] . 131 

A2-7.  Cumulative  Time  (CUMTIM)  [Node,  Entry] . 132 

A2-8.  Calls  Accepted/Rejected  (CALLS)  [Knode,  Entry].. .133 

A2-9.  Link  (LINKTB)  [Node,  Dest] . 134 

A2-10.  Seed  (SEEDTB)  [Node,  Distribution] . 135 

A2-11.  Link  Availability  (NLINES)  [Channel] . 136 

A2-12.  Queue  Entry  Count  (QCNT)  [Node] . 137 

A2-13.  Channel  Connectivity  (NODCHL)  [Link] . 138 

A2-14.  Alternate  Channel  (ALTCH)  [Channel] . 139 

A2-15.  Circuit  Switch  Arrivals  (CSARV)  [Knode,  Entry]. ..140 

A2-16.  Alternate  Destination  (DSTALT)  [Node,  Dest] . 141 

El.  Arrival  Pattern  1 . 241 

E2.  Arrival  Pattern  2 . 242 

E3.  Arrival  Pattern  3 . 243 

E4.  Arrival  Pattern  4 . 244 

E5.  Arrival  Pattern  5 . 245 

E6.  Arrival  Pattern  6 . 246 


CHAPTER  I 


.***«£8& 


yr 


INTRODUCTION 

1.  Computer-Communications  Networking 

The  steady  growth  of  the  data  processing  industry  and 
the  telephone  network  over  the  last  four  decades  have 
jointly  introduced  the  remote  sharing  of  information  data 
bases  as  a  cost-effective  management  tool.  The  power  of 
computer  facilities  has  been  made  available  to  classes  of 
users  through  terminals  connected  to  these  facilities  over 
a  communications  subnet  comprised  of  communication 
processors  (nodes)  and  common  user  circuitry  (links). 

Compute r- commun i cat i on  networks  are  created  by  this  marriage 
to  satisfy  general  networking  requirements  for  real  time 
transaction  power,  sharing  of  information  and  resources 
such  as  terminals,  a pp 1 i ca t i ons  ,  and  facilities,  distributed 
data  base  processing,  and  load  balancing.  Branscomb  [4] 
suggested  the  following  three  significant  reasons  for  the 
overall  success  and  cost-effectiveness  of  these  networks: 

(1)  Increasing  performance  for  decreasing  costs  of 
memory,  storage,  processors,  and  communications. 

(  2  )  Increasing  capability  and  reliability  of  computer 
[i  rograms  . 

(3)  Increasing  people  costs. 

The  Communications  o_f  the  Association  for  Computing 
Mach i nery  is  used  as  a  pattern  for  format  and  style. 


In  a  compu ter-commun i ca t i ons  network,  the  proper  alloca¬ 
tion  of  subnet  resources  such  as  communication  links,  switch¬ 
ing  nodes,  processing  units,  and  network  storage  elements  in¬ 
sures  uniform  facility  utilization,  stable  system  operation, 
and  acceptable  user  service.  Network  sharing  resources  are 
defined  as  he te reogeneous  computer  systems  called  hosts  that 
are  geographically  distributed  and  interconnected  by  the 
communications  subnet.  Within  a  computer-communications 
network  are  several  layers  of  protocol  (rules)  necessary  to 
escort  each  information  exchange  from  its  originating  node 
to  the  destination  node.  Existing  networks  are  designed  in 
a  variety  of  configurations,  which  include  centralized, 
distributed,  ring,  or  various  combinations  of  these  [16,  74]. 

1.1  Evolutionary  Development 

The  Department  of  Defense  Advanced  Research  Projects 
Agency  (ARPA  Network  (ARPANET))  is  the  predecessor  of 
existing  computer- communi cations  networks.  It  was  conceived 
with  the  concept  of  fast  and  reliable  transportation  of  data 
packets  (1000  bits  per  packet)  from  a  network  source  to  a 
destination  through  the  communications  subnet.  These  packets 
are  independently  routed  from  node  to  node  on  a  store  and 
forward  basis  until  the  final  subnet  node  is  reached.  They 
are  then  rearranged  and  delivered  to  the  "host"  system. 

The  ARPANET  still  exists.  It  links  together  several 
university  and  research  agencies.  It  has  become  an 
operational  network  for  continued  research  and  design  into 
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the  myriad  of  problems  associated  with  the  implementation  of 
compute r-communi cations  networks  . 

Since  the  inception  of  ARPANET  in  the  early  1960's, 
numerous  other  national  and  international  networks  have 
been  designed  and  implemented  [74,  89].  This  proliferation 
and  use  of  ARPANET  technology  has  proven  computer  networking 
to  be  cost-effective,  and  has  become  a  valuable  management 
tool  for  satisfying  needs  of  the  information  processing 
industry.  The  importance  of  computer  networking,  and  its 
impact  on  both  private  and  public  sectors  is  widely 
recogn i zed  [ 74]  . 

1.2  The  Case  for  an  Integrated  Packet/Circuit  Switch  Network 

Recent  Defense  Communication  Agency  (DCA)  studies  have 
shown  the  desirability  of  an  all-digital,  switched  network 
which  integrates  voice,  interactive  and  bulk  data  for  the 
1 980 1 s  [80,  90],  Several  additional  studies  relating  to 
information  processing  growth  in  the  next  few  decades  portend 
new  services  with  substantially  increased  data  flows  [4,  76, 
79,  83].  As  stated  by  Ross  [83],  "the  spectrum  of  terminals 
requiring  service  is  expected  to  range  from  46  bps  TTY 
terminals  and  2400  bps  vocoders  to  interactive  graphics, 
digital  facsimile,  and  slow-scan  video  terminals  requiring 
rates  in  the  tens  and  hundreds  of  kilobits  per  second".  To 
facilitate  the  implementation  of  these  classes  of  traffic, 
todays  and  future  computer-communications  networks  use  or 
plan  to  use  Circuit  Switching  (CS)  or  Packet  Switching  (PS) 


techniques  for  the  movement  of  data  through  the  subnet.  In 
a  circuit  switched  network  a  physical  end-to-end  path,  as 
opposed  to  the  store-and-forwardi ng  process  of  packet 
networks,  is  found  before  ( ommuni  cation  circuits  arid  buffers 
are  committed  for  the  duration  of  the  connection.  Both 
network  types  offer  a  wide  range  of  advantages  and  dis¬ 
advantages  depending  on  factors  such  as  class  of  data 
traffic,  user  applications,  interface  complexity,  and  user 
transparency.  The  projected  diversity  in  terminal  devices, 
growth  of  new  services,  and  advances  in  satellite 
communications.  Large  Scale  Integration  (LSI)  technology, 
digital  switching  and  transmission  capabilities,  give  rise 
to  the  potential  sharing  of  transmission  capacity, 
switching  equipment,  and  common  network  control  and 
signalling  to  reduce  network  costs.  The  need  for  a  uniform 
network  is  voiced  by  management  and  system  designers 
concerned  with  limitations  of  existing  networks  for 
projected  information  processing  requirements  and  services 
[3,  8,  10,  19,  21,  25,  41,  51,  54,  60,  69,  79,  84,  88]. 

1.3  Research  Objectives  and  Plans 

The  research  of  this  dissertation  investigates  the  flow 
of  data  and  voice  in  an  integrated  network.  The  research  is 
based  on  the  premise  that  unlike  existing  s to  re- a nd - f o rwa rd 
distributed  networks,  an  integrated  network  based  on  circuit 
switching  techniques  can  significantly  reduce  the  subnet 
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overhead  and  control  instabilities  inherent  in  such  networks, 
facilitate  increased  interoperability  between  existing  and 
projected  new  services,  and  place  the  burden  of  flow  control 
solely  at  end-point  nodes  where  more  efficient  controls  can 
be  exerted.  The  development  of  performance  evaluation  and 
control  tools  are  primary  research  objectives.  Switching 
mechanisms,  flow  control  considerations,  and  the  design  of 
analytical  and  simulation  models  are  emphasized. 

A  literature  review  of  architectural  considerations  and 
developments  is  provided  in  Chapter  II.  Detailed  concepts 
and  terminology  are  presented  as  support  material  to 
succeeding  chapters. 

Prior  research  efforts  have  investigated  architectural 
nodal  designs,  cost  trade-offs  between  circuit  and  packet 
network  types,  and  the  feasibility  of  a  uniform  network. 

There  lacks  (1)  an  efficient  analytical  tool  or  simulation 
model  that  characterizes  a  network  based  on  circuit 
switching  technigues  and  (2)  flow  controls  that  are 
applicable  to  such  a  network.  This  research  systematically 
investigates  and  classifies  existing  circuit/packet  flow 
control  strategies  into  a  framework  for  potential  network 
integration.  Chapter  III  presents  this  classification. 

The  lack  of  an  existing  model  has  reouired  extensive 
design  to  obtain  a  usable  network  simulator.  A  discrete 
event-driven  FORTRAN  simulator  is  implemented  that  integrates 
common  data/voice  call  management,  traffic  on  trunk  lines. 
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and  an  underlying  circuit  switched  communications  subnet. 
Its  developmental  goals  are  two-fold: 

(1)  To  be  sufficiently  general  in  structure  so  that 
several  design  factors  can  be  varied  by  the  user 
to  evaluate  network  performance  by  collecting 
ernp  i  r  i  c a  1  data,  and 

(2)  To  be  a  cost-effective  highly  portable  tool  that 
has  application  in  an  environment  where  computer 
resources  are  limited. 

Chapter  IV  details  this  development. 

The  need  for  analytic  representation  of  the  network 
leads  to  the  formulation  of  an  algorithm  for  analytic 
representation  of  nodal  behavior.  This  algorithm  permits 
the  decomposition  of  the  network  to  determine  nodal  steady- 
state  measures  of  effectiveness.  It  is  based  on  (1)  an 
application  of  a  rate  matrix  from  queueing  theory,  and  (2) 
similarity  transformations  involving  eigenvalues  and 
eigenvectors  using  linear  matrix  concepts.  Chapter  V 
presents  the  development  of  this  algorithm.  A  ring  control 
hierarchy  for  network  nodal  flow  control  is  presented  in 
Chapter  VI.  Analysis  of  network  flow  behavior  is  outlined 
in  Chapter  VII. 

finally,  a  summary  of  the  results  of  the  research, 
conclusions,  and  proposed  recommendations  and  suggestions 
for  further  research  are  presented  in  Chapter  VIII. 
Applicable  simulation  data  and  program  listings  of  the 


CHAPTER  I  I 


LITERATURE  SURVEY 

2  .  Ove  rvi ew 

Desiqn  implementations  for  communications  processing  in 
data  networks  have  been  based  on  analog  transmission  and 
either  circuit  or  s to  re  -  an d - f o rwa r d  switching  principles. 

The  gradual  emergence  of  highly  efficient  digital  transmission 
paths,  projected  requirements  for  speech,  data,  and  video 
[4,  54,  79],  and  the  increased  utilization  of  Time  Division 
Multiplexinq  (TDM)  techniques  provide  motivation  for  a 
uniform  system  design  to  handle  all  classes  of  traffic. 
Cicchetti  and  Lubarsky  summarized  several  unique  design 
problems  which  an  integrated  voice/data  system  must  address 
[8]:  . 

(1)  Common  calling  establishment/disestablishment 
procedures  , 

(2)  an  order  of  magnitude  increase  in  traffic  volume 
at  the  nodes, 

(3)  end-to-end  network  and  error  controls, 

(4)  pri  or  i  ty/preeinp  t  i  on  controls  for  voice  and 
data  ,  and 

(5)  the  diqitizntion  of  all  traffic. 

2.1  Network  Design  Areas 

The  underlying  structure  of  an  integrated  network  will 


9 


rely  on  circuit,  s to  re  -  a n d - f o rwa r d  ,  or  hybrid  switching. 

There  appears  to  be  disagreement  on  which  structure  offers 
the  most  promise  [8,  10,  18,  20,  25,  31,  41,  46,  47,  57,  58, 
69,  / 9,  88,  90,  99,  IOOJ.  Independent  of  the  underlying 
switching  structure,  the  major  problems  unique  to  an 
integrated  network  architecture  can  be  categorized  into  the 
following  design  areas: 

(a)  Integration  Methodology 

(b)  Line  Switching 

( c )  Routing 

(d)  flow  Control 

(e)  Nodal  Design 

(f)  P r i or i ty / P reemp t i on  Controls 

2.1.1  Integration  Methodology 

The  two  major  forms  for  transmitting  data  in  use  today 
are  analoq  and  digital.  Analog  transmission  techniques 
represent  a  voice  or  data  transaction  by  an  analog  signal 
continuously  varying  in  voltage  or  current  with  respect  to 
time.  The  amplitude1  represents  the  information.  Using 
digital  transmission  techniques,  all  data  is  represented 
as  a  discrete  code  with  constant  amplitude.  The  information 
is  retained  on  a  serial  time  basis.  Digital  voice  is  common¬ 
ly  obtained  bv  using  Pulse  Code  Modulation  (PCM)  to  convert 
voice  samples  to  a  binary  code  of  several  bits  [68]. 

Although  analog  transmission  has  been  the  mainstay  of 
communications  processing,  the  increasing  requirements  for 
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transmitting  digital  data  and  interfacing  to  digital 
eguipment,  coupled  with  the  advantages  of  PCM  switching, 
have  resulted  in  a  gradual  shift  to  digital  transmission 
i  mp  1  einen  t a  t  i  on  [97]. 

The  family  of  Bell  System  T-Carrier  Transmission  Systems 
form  the  foundation  for  digital  transmission.  Two  levels  of 
T-Carrier  Systems  predominate  today,  the  T1  for  short 
distance  transmission  (50  miles)  and  the  T2  for  distances  up 
to  500  miles.  Each  T1  carrier  provides  a  link  capacity  of 
1.544  megabits  per  second  (which  is  subdivided  into  multiple 
Half  Duplex  (HDX)  channels),  and  represents  the  major 
building  block  for  any  integrated  methodology  design. 

Integration  methodology  is  concerned  with  the  allocation 
of  the  T1  link  into  multiple  subframes,  each  containing  time 
slot  packets  of  data,  whether  the  data  be  facsimile,  bulk, 
message,  packet,  etc.,  (Fig.  1)  With  fixed  allocation 
scheme,  a  specific  number  of  t  me  slots  are  reserved  for 
each  class,  guaranteeing  that  each  is  given  a  prescribed 
grade-of-service  (Fig.  la).  A  major  limitation  of  this 
design  is  the  inability  to  make  use  of  unused  link  capacity. 

A  dynamic  allocation  scheme  incorporates  a  movable  frame 
*  boundary  which  permits  unused  slots  in  one  class  to  be  made 

available  as  slots  to  other  classes  of  data  (Fig.  lb).  This 
scheme  results  in  a  better  utilization  of  the  link  capacity, 
but  reguires  considerable  loqic  to  implement  [21,  31].  The 
research  model  will  investigate  a  third  allocation  approach  - 


1  .  All ocati on  schemes 


(a)  Fixed  boundary 


(b)  Movable  boundary 


(c)  Competitive  allocation 
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competi ti ve  al location  (Fig.  lc).  Using  this  approach, 
classes  of  data  compete  for  time  slots  using  a  first-come- 
first-served  (FCFS)  scheme.  This  will  insure  maximum  usage 
of  each  frame;  in  addition,  the  need  for  various  types  of 
boundary  controls  will  be  investigated  by  statistically 
measuring  subscriber  (end  user)  delays  and  traffic  flow. 

2.1.2  Line  Sw itching 

Sanders  defines  digital  line  switching  as  the  process 
whereby  a  digital  switch  receives  data,  stores  it  for  a 
period  of  time,  and  forwards  it  to  another  switch  over  some 
channel  [88],  Data  network  switching  design  is  based  on 
circuit  or  s tore-a nd- forwa rd  principles.  Store-and- forwa rd 
switches  (nodes)  group  bits  into  packets  or  messages 
(multiple  packets),  and  route  them  among  each  other  using 
nodal  tables  and  a  network  routing  algorithm  until  the  final 
destination  is  reached.  When  a  switch  receives  a  packet  or 
a  message,  an  acknowledgment  is  returned  to  the  sending  node 
and  on-going  switching  responsibility  is  assumed.  Since  the 
path  from  source  to  destination  is  not  a  physical  connection, 
gueues  may  build  at  the  various  switching  nodes,  creating 
variable  delays.  There  have  been  numerous  data  networks 
designed  with  s t o re -a n d - f o rwa r d  switching,  with  corresponding 
performance  evaluation  widely  documented  [6,  9,  18,  34,  49, 
50,  56,  67,  72,  81,  82,  86].  A  circuit  switching  design 
involves  the  transmission  of  data  through  a  nodal  crosspoint 
structure  to  effect  a  link  between  two  channels.  The 
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replacement  of  analog  e 1 ec t romechan i cal  switching  elements 
such  as  step  by  step,  crossbar,  relay,  correeds,  etc.,  with 
digital  Medium  Scale  Integration  MSI)  SN7454,  SN74150,  and 
SN74200  chips  as  the  crosspoint  elemens  provides  faster 
switching  and  reduced  cross  network  de  ay  [27,  28,  55,  68, 
98].  Commercia1  digital  circuit  switches  are  now  avuilabl- 
combining  TDM  principles  with  PCM  switching  using  MSI  logic 
and  Random  Access  Memory  (RAM)  as  cros'  point  elements  to 
produce  nanosecond  switching  speeds  [31',  68].  The 
implementation  of  PCM  switching  requires  an  information 
memory  to  provide  fixed  channel  assignments  for  both 
transmit  and  receive  inlets,  and  a  connection  memory  which 
contains  the  stored  routing  information  for  the  connection 
(Fig.  2).  Physical  circuits  (Full  Dup  ex  (FDX)  channels) 
are  thus  established  between  subscribers  and  maintained  for 
the  duration  of  a  transaction.  As  a  result,  no  queues  build 
up  along  the  route.  Performance  comparisons  between  circuit 
and  s to  re -and- f orwa rd  switching  show  that  the  crossover 
efficiency  is  highly  dependent  on  the  implementation 
structure  [18,  58,  81,  82,  87,  88]. 

The  switching  design  in  a  uniform  system  should  be  the 
most  efficient  structure  for  moving  data  among  multiple  Tl 
links  and  nodes.  A  research  model  is  designed  and  implemen¬ 
ted  on  the  premise  that  an  underlying  digital  circuit  switch 
structure  offers  more  potential,  since  microtechnology  has 
made  subscriber-to-subscri ber  control  designs  cost  effective 
alternatives  to  subnet  controls  [88], 


?  .  I  .  j  Pouting 

Pouting  design  involves  the  joint  cooperation  between 
an  appropriate  network  routing  algorithm  and  a  switching 
structure  to  effect  the  steering  of  a  transaction  between 
subscribers.  Circuit  switch  routing  within  the  American 
Telephone  and  Telegraph  (AT&T)  system  is  based  on  a  fixed 
nodal  routinq  algorithm  and  a  rigidly  defined  hierarchical 
structure  in  which  a  node  higher  in  the  hierarchy  is  not 
at. cessed  unless  blocking  (no  available  circuit)  occurs  at  a 
lower  level.  The  Department  of  Defense  (DoD)  AUTOVON  network 
is  another  symmetrically  designed  circuit  switching  structure 
so  that  all  nodes  are  of  equal  rank.  furthermore,  routing 
decisions  in  the  AUTOVON  are  controlled  at  each  node  using 
an  adaptive  algorithm  [24], 

to  re  -  and  -  f  o  rw.i  rd  routin'!  algorithms  are  characterized 
by  fixed  or  stochastic  routing  strategies  with  centralized 
or  distributed  control  [43],  As  opposed  to  the  circuit 
switch  routinq  process,  a  physical  end-to-end  path  is  not 
established.  Instead,  virtual  circuit  connections  permit  a 
transaction  to  proceed  through  the  network  with  each  node 
responsible  for  routing  using  nodel  routing  tables  and 
knowledge  of  the  system  routing  algorithm.  The  TYMNET  and 
TELENET  typlify  two  of  the  most  prominent  commercial  store- 
and-forward  networks  which  exhibit  differing  routing  design 
[77,  78], 

In  an  integrated  network  any  one  or  a  combination  of 
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routing  algorithms  maj  apply.  However,  a  significant 
structural  innovation  occurs  with  the  availability  of  the 
high  speed,  high  capac i ty  Common  Channel  Interswitch 
Signalling  (CCIS)  system.  CC1S  in  an  integrated  digital 
network  can  be  obtained  by  reserving  a  specified  number  of 
frame  slots  for  use  as  a  signalling  channel  dedicated  to  the 
transfer  of  network  signalling  messages.  Routing  information 
is  then  transmitted  over  the  channel  by  grouping  routing 
data  into  multiple  groups  of  Signal  Units  ( S U }  ,  each  28 
bits  in  length  [11].  CCIS  achieves  error  control  by 
redundant  coding  within  Signal  Units  and  error  correction  by 
retransmission.  The  signalling  network  concists  of  common 
CCIS-equipped  signalling  capabilities  at  each  node.  Since 
the  routinq  design  must  resolve  problems  involving  speed, 
path  selection,  and  the  network  decision  making  process,  the 
innovation  of  CCIS  demands  a  reappraisal  of  existing  routing 
algorithms  for  use  in  an  integrated  environment. 

2.1.4  flow  Control 

A  flow  control  strategy  is  concerned  with  insuring 
a  smooth  movement  of  traffic  throughout  the  network  under 
normal  and/or  adverse  conditions.  flow  control  in  data 
networks  is  frequently  an  application  of  queueing  theory. 

The  literature  abounds  with  detailed  models  using  queueing 
analyses  for  various  configurations  in  telephone  exchanges, 
computer  networks,  and  host  computer  systems  [6,  7,  26,  38, 
49,  53,  64,  65,  67,  76].  The  utility  of  data  flow  controls 


must  be  subjected  to  close  scrutiny  under  simulated 
integrated  loading  to  determine  any  viability  for  use  in 
a  uniform  network.  Flow  control  link  design  must  address 
problems  associated  with  mixing  classes  of  traffic  over  a 
common  transmission  medium.  Frame  slot  sizes  in  allocation 
schemes  are  based  on  Voice  Digitization  Rates  (VDR)'s  which 
range  from  16  Kb/sec  to  64  Kb/sec  for  good  speech  character¬ 
istics,  and  packet  sizes  which  may  range  to  several  thousand 
bits  requiring  multiple  slots.  Analysis  of  various  models 
has  resulted  in  several  data/voice  efficiency  determinations 
[21 ,  25,  37,  57,  60,  84,  94], 

The  reduction  in  prices  of  vocoders  (voice  coder)  and 
technical  achievements  involving  packet  speech  transmission 
attest  to  the  ready  integration  of  voice  and  data  [23,  25, 
55].  Flow  control  design  involving  packet  speech  is 
primarily  concerned  with  the  network's  ability  to  utilize 
free  time  in  voice  transmissions.  By  packetizing  voice,  it 
is  treated  similar  to  other  data  classes.  If  voice  is  not 
packetized,  then  other  means  must  be  employed  to  recognize 
periods  of  no  data  to  fully  utilize  the  link.  Voice 
multiplexing  is  a  technique  that  could  be  used  to  permit 
more  efficient  utilization  of  a  voice  link  [23]. 

As  previously  described,  network  subscriber  connections 
can  be  either  physical  or  virtual  s to  re  -  a nd - f orwa rd  circuits. 
The  research  model  integrates  both  types.  There  is  a  con¬ 
sensus  in  the  literature  that  both  types  of  connections  will 
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be  needed  in  an  integrated  network  [8,  21,  25,  41,  47,  52, 
60,  79,  84,  99]. 

The  packet  design  in  an  integrated  network  demands  very 
responsive  flow  controls.  The  maintenance  of  proper  flow 
rate  between  subscribers,  and  the  prevention  of  nodal  over¬ 
loading  are  the  two  primary  areas  of  control.  Since  a  flow 
control  design  does  not  permit  tractable  analytical  solution 
[30],  simulation  is  a  tool  which  will  be  applied  to  the 
research  model  to  determine  a  strategy  or  combination  of 
strategies  which  results  in  the  most  efficient  system 
perf ormance . 

2.1.5  Nodal  Design 

Several  network  a rch i tectures  have  been  proposed  for 
the  nodal  integration  of  both  voice  and  data  [10,  25,  41, 

47,  48,  54,  83,  84,  87],  Since  the  research  model  is  based 
on  an  underlying  circuit  switch  subnet  with  shared  access  to 
the  subnet  links,  emphasis  is  restricted  to  the  design 
considerations  relating  to  this  structure. 

2. 1.5.1  Circuit  Switch  Architecture 

The  recognition  that  modular  multiprocessor  configura¬ 
tions  and  Mu  1 1 i pi  ex i ng/Demu 1 1 i p 1  ex i ng  (Mux/Demux)  mechanisms 
are  mandatory  requirements  [1  0  ,  41,  .84  ,  99  ]  is  significant 
in  the  design  of  a  circuit  switch  node.  The  termination  of 
local  subscribers,  multiple  T1  links,  and  requisite  communi¬ 
cations  processing  regu  i  reinen  ts  dictate  that  a  single  CPU 
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architecture  is  inadequate.  Fig.  3  illustrates  a  node 
terminating  three  FDX  T1  circuits,  with  associated  buffers. 
Assuming  a  VDR  of  32  Kb/sec,  a  10  ms  frame  period,  all  slots 
dedicated  to  voice,  and  a  DMA  of  320  bits  per  buffer,  a 
processing  capability  of  28,000  interrupts  per  second  would 
be  required.  Assuming  a  nominal  processor  capability  of 
500,000  instructions  per  second  and  an  interrupt  processing 
requirement  of  20  instructions  per  interrupt,  576,000 
instructions  per  second  are  needeG,  clearly  beyond  the 
capabilities  of  the  node.  Jenny  [40]  envisions  a  total  woik- 
,oad  on  a  nodal  processor  of  10,000,000  instructions  per 
second.  To  satisfy  this  processing  load  Ross  [84]  provides 
an  evaluation  of  alternative  nodal  architectures,  recommend¬ 
ing  a  distributed  architecture  with  a  partitioning  of  system 
processing  to  provide  modular  autonomy,  parallel  processing 
for  high  throughput,  and  inherent  modular  expandability. 

The  major  software  design  required  in  each  circuit 
switch  node  consists  of  (1)  system  routing,  (2)  communication 
processing,  (3)  lint  data  Mux/Demux,  and  (4)  data  collection. 

Tne  system  routing  module  is  responsible  for  the 
selection  of  the  most  feasible  path  by  coordinating  the  path 
selection  with  the  Mux/Demux  mechanism  and  the  signalling 
network.  When  a  route  is  requested,  this  module  seeks  a 
path  based  on  the  network  routing  algorithm  using  CC1S.  Orce 
a  route  is  obtained,  the  control  memory  associated  with  the 
Mux/Demux  mechanism  is  updated.  The  appropriate  channel 
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tables  must  be  updated  to  reflect  a  channel  active  condition 
along  with  any  statistical  updating.  With  the  receipt  of  a 
connec t i on/ term i na t i on  reguest,  this  module  must  coordinate 
the  release  of  the  Mux/Demux  connection  memory  route,  and 
perform  any  channel  table  updating. 

The  communication  processing  modules  are  responsible 
for  the  autonomous  handling  of  the  T1  links  and  any 
subscriber  terminals.  These  modules  must  coordinate  a 
Direct  Memory  Access  (DMA)  Input/Output  scheme  with  the 
Mux/Demux  mechanism  and  bus  structure.  All  link  and 
terminal  error  controls  will  be  managed  by  this  module. 

The  Mux/Demux  mechanism  utilized  in  an  integrated 
network  would  improve  on  the  digital  crosspoint  structured 
circuit  switches.  It  is  envisioned  that  larger  high  speed 
memories  with  stored  program  control  and  higher  speed 
switching  logic  would  be  reguired  [68,  93],  Several 
Mux/Demux  designs  have  been  proposed  [10,  15,  20,  40,  41, 

69,  90,  94,  99]. 

The  data  collection  module  would  be  responsible  for 
gathering  performance  evaluation  information.  Essential 
statistics  relating  to  link  utilization,  nodal  traffic 
loadings,  link  and  nodal  failure  occurrences,  etc.,  are 
necessary  to  provide  both  grade- of -se r v i c e  and  network 
t  un  i  ncj . 

The  storage  requirements  at  each  subnet  node  would 
consist  of  (i)  channel  buffers  utilized  for  the  time  division 


mechanism,  (2)  table  storage,  and  (3)  module  storage. 

Storage  is  not  a  major  design  consideration  because  minimal 
gueueing  occurs  at  subnet  nodes. 

2. 1.5. 2  Packet  Switch  Architecture 

Each  packet  node  terminates  multiple  types  of  data 
subscribers  and  interfaces  to  a  circuit  switch  using  a 
digital  TDM  link.  Packet  switch  nodal  design  has  three 
primary  objectives: 

(1)  To  provide  sufficient  buffer  storage  for  incoming/ 
outgoing  packets. 

(2)  To  insure  the  Multiplexing/Demultiplexing  of 
subscriber  processes  according  to  a  designated 
routing  scheme. 

(3)  To  utilize  flow  control  strategies  which  minimize 
gueueing  and  congestion  problems. 

To  accomplish  these  objectives,  the  nodal  design  must 
accommodate  an  order  of  magnitude  increase  in  data  traffic, 
and  insure  responsive  flow  controls  and  routing  schemes. 

The  termination  of  multiple  subscriber  devices  ranging  from 
75  bps  teletypes  to  200  Kbs  video  terminals  suggests  a 
mu  1 1 i p ro cess o r  ,  multi-bus  structure  such  as  that  employed 
in  the  PLURIBUS  design  [63],  Such  a  structure  permits  a 
flexible  bus  configuration  of  subscriber  speeds.  In 
addition,  there  is  no  assignment  of  priority  among  the 
multiprocessors,  permitting  autonomous  processing  of 
subscriber  processes,  with  all  nrocessors  having  access  to 
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system  tables  via  shared  memory. 

Ihe  two  major  software  modules  required  to  support  the 
stated  objectives  are  (1)  process  Mux/Demux,  and  (2)  process 
r  o  u  t  i  n  q  . 

The  process  Mux/L'emux  module  essentially  establishes  a 
logical  connection  (circuit)  between  any  subscriber 
processes,  and  coordinates  their  arrival  and  tneir  dispatch. 
The  logical  connection  remains  until  the  subscriber  elects 
to  break  the  connection.  Subscriber  connection  tables  must 
be  maintained  in  each  node  to  keep  a  record  of  any  outstand¬ 
ing  connections.  In  an  integrated  network,  the  problem  of 
connection  permission  between  classes  becomes  significant; 
that  is,  which  subscribers  are  allowed  to  i nter-communi cate? 
The  research  model  dons  not  address  communications  between 
classes;  however,  module  design  could  easily  include  such 
connections,  using  an  added  entry  for  permission  authority. 

The  process  routing  module  keeps  a  record  of  all 
current  routes  between  this  node  and  any  other  packet  nodes. 
The  destination  cumber  is  the  mechanism  that  accomplishes 
this  routing,  and  at  least  two  alternative  techniques  could 
be  used : 

(I)  Unique  (ilob.il  Destination  Numbers 

(?)  Unique  Local  Destination  Numbers 

Technique  (1)  uniquely  identifies  each  process  anc  node 
in  the  network.  The  obvious  problem  with  this  technique  is 
one  of  sheer  complexity  and  maintenance.  A  system  overseer 
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must  control  the  assignment  of  destination  numbers. 

Technique  (2)  proposes  that  each  process  header  have 
an  imbedded  identifier  which  denotes  the  process  as  local  or 
global  to  the  packet  switch.  If  identified  as  global,  then 
a  simple  table  look-up  procedure  can  determine  the  destina¬ 
tion  numter.  At  the  destination  end,  the  imbedded 
identifier  can  be  similarly  converted.  A  destination 
number  identified  as  local  to  a  packet  switch  is  used  for 
inward  routing,  i.e.,  local  subscriber  to  local  subscriber. 

2.1.6  I1  r  i  or  i  ty/P  reemp  ti  on  Controls 

The  requirement  for  network  priority/preemption  control 
is  necessary  in  data  networks  [66,  90].  Design  objectives 
a  re  identified  to  be  twofold: 

(1)  There  must  be  a  mechanism  that  facilitates  the 
rapid  delivery  of  high  precedence  traffic,  and 

(2)  A  capability  must  exist  to  preempt  existing 
traffic  connections. 

The  design  of  slot  allocations  must  include  priorities 
for  subscriber  traffic  and  probable  system  saturation 
conditions.  Should  the  allocation  scheme  establish  c 
priority  f c r  service,  i.e.,  all  voice  calls  first,  then 
video,  packets,  bulk,  etc?  Should  a  prescribed  number  of 
slot;  be  reserved  for  high  priority  traffic  -  independent 
of  class?  If  there  is  no  slot  priority  scheme,  how  are 
slots  preempted  in  a  saturated  sys ten ?  What  selection 
criteria  for  slot  removal  is  to  be  employed?  How  many 


slots  can  be  preempted?  Should  the  pr i ori ty/ preempti on 
structure  be  dynamically  configured? 

Precedence  levels  constitute  a  major  nodal  mechanism 
for  providing  grades  of  service  [90].  A  preemption 
capability  can  be  implemented  by  permitting  a  high 
precedence  subscriber  transaction  to  interrupt  an  on-going 
lower  level  precedence  transaction.  Following  the  interrupt, 
*  resumption  of  the  interrupted  transaction  can  be  rein¬ 

stigated. 

i 

I 

| 

I 
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relationships  involving  routing  and  load  sharing,  efficient 
use  of  physical  resources  {buffers,  transmission  bandwidth, 
processor  time),  and  an  ever  increasing  requirement  for 
support  of  diverse  types  of  subscribers.  The  implementation 
or  design  of  a  viable  flow  regulated  system  and  the  creation 
of  a  desirable  user  environment  involves  the  application  of 
many  communication  and  networking  techniques.  Major  factors 
that  impact  directly  on  the  need  for  flow  controls  are 

(1)  sy nch ron i za t i on  of  information  flow  on  the  data  links, 

(2)  detection  and  recovery  from  transmission  error,  (3) 
traffic  routing  from  node  to  node,  and  (4)  interfacing  of 
subscriber  processes  to  each  other  and  the  network  [95]. 

The  solution  to  the  flow  control  problem  has  been  ad  hoc  to 
date,  but  there  is  a  growing  consensus  that  it  consists  of 

a  combination  of  flow  control  strategy  and  structural  flow 
layers  [30,  33,  35,  44,  45,  61,  62], 

3.1  Structural  flow  Control  Layers 

The  Advance  Research  Project  Agency's  (ARPA)  experience 
with  the  ARPANET  has  shown  that  structural  layers  of  flow 
control,  with  each  layer  possessing  well  defined  respon¬ 
sibilities,  offers  a  unified  networking  implementation  of  the 
aforementioned  flow  control  factors  [33],  The  international 
acceptance  of  X.26  (Interface  Between  Data  Terminals  Opera¬ 
ting  in  the  Packet  Mode  on  Public  Networks)  [35]  provides 
additional  motivation  for  the  layered  approach.  Although  the 
formal  layers  of  control  vary  from  implementation  to 
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FLOW  CONTROLS  IN  DISTRIBUTED  COMPUT E R -COMMUN I  CAT  I  ON  NETWORKS 

3.  Problem  Definition 

The  primary  objective  of  all  computer-communication 
networks  is  to  transoort  information  between  its  subscribers 
(typically  a  subscriber  is  a  software  processor,  a  subsystem, 
a  human  user,  or  a  terminal  device)  in  a  timely  and  error 
free  manner.  Frequently,  however,  peak  hour  requirements, 
traffic  load  fluctuations,  system  component  failures,  or 
adverse  network  load  distributions  create  an  environment  in 
which  the  movement  of  information  throughout  the  network  has 
to  be  controlled.  Failure  to  do  so  results  in  conges ti on  -  a 
network  condition  as  a  result  of  which  the  network  must 
reject  any  further  input  of  traffic.  F 1  ow  con tjro  1  is  the 
set  of  mechanisms  that  attempt  to  match  subscriber 
transmission  and  acceptance  rates  while  minimizing  network 
congestion.  The  development  of  adequate  flow  control 
mechanisms  to  regulate  subscriber  input  rates  within  computer 
communication  networks  is  generally  referred  to  as  f 1 ow 
control  strateqy  (30], 

The  rapid  arawth  in  the  last  decade  of  distributed 
r e sou rce -s ha r i n g  s t ore -a nd- f o rwa r d  compu te r- commu n i ca t i on 
networks  such  as  ARPANET.  TYMNLT,  TELENET  CYCLADES  [33,  70, 
92]  has  spawned  a  myriad  of  t,  w  control  problems.  This  has 
resulted  because  such  networks  possess  complex  inter- 


implementation  [1,  33,  72,  95],  essentially  all  implemen¬ 
tations  provide  three  hierarchical  levels  of  interface: 

(1)  s ubs c r i be r- s ub s c r i ber 

(2)  s ub s c r i be r- s ub ne t 

( 3 )  node-node 

Within  each  of  these  levels  reside  the  software  modules 
that  produce  the  protocol  needed  to  insure  each  subscriber- 
subscriber  information  transfer. 

The  s ubs cr i ber-sub sc r i be r  level  performs  as  a  software 
mul t i p 1 exor /demu 1 t i p 1 exor  between  subscriber  processes  and 
the  interface  to  the  subnet.  Flow  control  at  this  level 
involves  coordinating  the  dispatch  and  the  arrival  of 
information  with  subscriber  processes  and  buffer  storage 
[45  J . 

The  s ubs c r i ber- s ubne t  protocol  coordinates  the  transfer 
of  data  between  a  subscriber  process  and  the  subnet.  Flow 
control  within  this  level  is  bounded  by  two  extremes  -  a 
simple  protocol  that  is  applied  only  during  the  selection 
and  the  clear  phases  of  a  circuit  or  message  (one  or  more 
packets)  switch  connection,  to  complex  logic  involving 
packet  sequencing,  efficient  use  of  bandwidth,  error 
detection,  buffer  allocation,  subscriber  responsiveness, 
and  information  transfer  acknowledgement  schemes  using  a 
High  Level  Data  Link  Control  (HDLC)  [35]. 

The  node-node  protocol  level  insures  a  smooth 
information  flow  from  the  time  each  message  or  packet  enters 
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the  subnet  until  it  is  delivered  through  an  exit  node  .  !n 
nil  store  and  forward  networks,  this  entails  that  an  adequate 
supply  of  buffer  storage  exists  along  the  path  that  the 
information  will  traverse,  flow  controls  supported  by  this 
protocol  level  are  concerned  with  error  detection  and 
recovery  ca pa b i  1  i t i es  ,  routing  techniques  (adaptive/ 
deterministic),  buffer  availability,  acknowledgement 
techniques,  and  the  decoupling  of  the  subscriber  from  any 
network  responsibilities. 

3.2  Overview  of  a  Flow  Control  Strategy 

A  fundamental  rule  of  communications  systems  is  that 
the  source  subscriber  cannot  simply  send  information  to  a 
destination  subscriber  without  some  mechanism  for 
guaranteeing  storage  for  that  data  [56].  McQuillan  and 
Walden  suggest  that  this  can  be  accomplished  in  two 
fundamental  yet  conflicting  ways. 

(1)  The  source  and  destination  subscribers  agree  on 
the  amount  of  information  to  be  transferred  prior 
to  the  transfer,  or 

(2)  There  is  an  acknowledgement  sequence  between 
source  and  destination  subscribers  throughout  the 
i  n  f  or ma  t.  i  on  ex<  hanqe  . 

Technique  one  is  associated  with  high  throughput  (bulk  type 
transfers),  whereas  technique  two  implies  low  delay  (e.g.,  an 
interactive  environment).  All  flow  control  strategies 
developed  to  date  for  use  in  store- and -forward  systems  have 
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contended  with  t  h  e  s  e  conflicting  techniques. 

3.3  Objectives  of  a  Flow  Control  Strategy 

The  goals  and  objectives  of  flow  control  strategies 
are  frequently  ill-defined  but  are  generally  categorized  as 
foil ows  [29,  71  ]  . 

(a)  Congestion  Prevention 

(b)  Deadlock  Prevention 

(c)  End-to-End  Flow  Control 

(d)  Fair  Allocation  of  Communication  Resources 

3.3.1  Congestion  Prevention 

The  flow  control  scheme  should  make  it  easy  to  slow  or 
stop  transmission  from  the  source  subscriber  within  limits 
compatible  with  available  network  resources. 

3.3.2  Deadlock  Prevention 

When  congestion  does  occur,  resources  must  be  available 
to  handle  t raf f i c- cl ea ri ng  messages.  In  addition,  to  fully 
utilize  the  available  bandwidth,  different  strategies  may  be 
appropriate  for  different  modes  of  traffic. 

3.3.3  End-to-End  T1 ow  Control 

Flow  control  for  a  particular  level  of  protocol  should 
be  exerted  at  the  point  closest  to  the  final  destination. 

In  addition,  the  flow  control  strategy  must  consider  the 
resource  management  scheme  provided  by  a  destination 
subscriber  or  exit  node. 
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3.3.4  Fair  Allocation  of  Communication  Resources 

A  flow  control  strategy  must  insure  that  resources  such 
as  nodal  and  subscriber  buffers  and  communication  bandwidth 
are  not  monopolized  by  one  sou rce/ des t i n a t i on  subscriber  or 
that  component  failures  do  not  invalidate  the  strategy. 

These  flow  control  strategy  objectives  are  difficult 
to  achieve,  and  are  further  complicated  by  the  addition  of 

•  control  information  overhead  and  the  quest  for  network 
transparency  and  resource  optimization. 

3.4  Flow  Control  Strategies 

\ 

A 1  thou qh  flow  control  strategies  are  classified  in  the 
literature  as  local  or  global  [6,  30,  45],  a  more  meaningful 
network  relationship  can  be  discussed  by  considering  whether 
or  not  the  strategy  is  subnet  or  subscriber  controlling. 

That  is,  does  the  strategy  attempt  to  regulate  the  network 
directly  or  the  subscriber?  Existing  or  proposed  strategies 
that  apply  as  potential  techniques  for  an  integrated  network 
(Table  I)  will  now  be  discussed. 

3.4.1  Subnet  Controlling 

Subnet  controlling  strategies  attempt  to  regulate  the 

•  subnet  nodes,  thus  preventing  the  network  from  becoming 
overloaded.  This  is  accomplished  either  through  the  use  of 

.  table  arid  control  information  periodically  being  passed 

throuqh  the  network,  or  by  the  detection  and  correction  of 
a  congestion  in  a  particular  node  by  a  centralized 

< 

4 

\ 


intell iqence  center  or  autonomous  nodal  design. 

3. 4. i.l  Isarithmic 

This  strategy,  first  proposed  by  Davies  [12],  is  based 
on  the  premise  that  network  congestion  can  be  measured  by 
the  number  of  packets  (a  packet  is  a  fixed  number  of  bits) 
in  transit  over  all  communication  paths  in  the  network. 

With  this  approach  the  information  transfer  can  be  regulated 
by  placing  a  limit  on  the  total  number  of  packets  in  the 
network  at  any  time  t.  Simulation  studies  [12,  73]  have 
modeled  this  approach  by  associating  at  each  node  two 
gueues  -  a  permit  and  a  packet  queue.  As  each  packet  enters 
the  network,  the  source  node  permit  queue  is  decremented  by 
1;  likewise,  on  arrival  at  a  destination  node,  the  permit 
queue  is  incremented  by  1. 

Simulation  performance  results  and  improvements  to  the 
model  involving  permit  re d i s t r i bu t i on  schemes  have  shown 
the  isarithmic  technique  to  be  an  effective  mechanism  for 
regulating  input  traffic  operating  under  a  variety  of  control 
protocols  and  system  loads.  Although  this  approach  has  not 
been  implemented,  it  does  highlight  the  dilemna  between  high 
bandwidth  and  low  delay  ( compu ta t i ona 1 1 y  simple),  yet 
appearing  to  be  stable  for  large  networks  [12,  33].  It  has 
three  major  drawbacks,  namely: 

(1)  There  are  considerable  delays  before  some  packets 
receive  attention  due  to  "bunching"  of  permits  at  some  nodes 
when  needed  elsewhere,  (2)  it  does  not  correct  the  congestion 
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problem  when  a  destination  subscriber  cannot  accept  packets 
fast  enough  from  a  source  [33],  and  (3)  it  has  no  method  for 
redistributing  permits  when  network  component  failure  has 
occurred  . 

3. 4. 1.2  Centralized  Flow  Control  Station 

A  centralized  flow  control  strategy  is  one  which 
utilizes  an  intelligent  control  point  for  monitoring  network 
performance.  This  control  mechanism  {a  master  supervisor) 
is  constantly  exchanging  control  information  with  all  subnet 
nodes  to  determine  delays  on  all  paths.  The  global  status 
of  the  network  is  maintained  through  a  flow  control  matrix 
whose  elements  represent  the  delays  received  from  the  nodes 
on  a  periodic  basis. 

Each  node  contributes  a  column  specifying  the  delays 
from  that  node  to  its  directly  connected  neighboring  nodes. 
For  example,  this  strategy  is  implemented  on  the  TYMNET 
network  by  a  supervisor  module  in  the  Network  Routing  Center 
(NRC),  which  establishes  a  route  for  each  transaction 
between  a  sou rce -des t i na t i on  pair  using  the  delay  matrix 
information  [86,  92],  This  strategy  provides  global 
knowledge  for  routine)  and  control  [86].  It  has  major 
shortcomings  in  its  inherent  difficulty  of  reacting  guickly 
to  nodes  remotely  located  from  the  control  mechanism  and 
its  heavy  utilization  of  network  bandwidth  for  monitoring 
and  control  [33], 


3. 4. 1.3  flow  Control  Tables 


Gerla  described  a  flow  control  table  strategy  where  each 
node  controls  its  input  rate  on  the  strength  of  information 
contained  in  flow  control  tables  which  are  periodically 
circulated  in  the  network  [30].  These  tables,  continuously 
updated  while  circulating  in  the  network,  contain  information 
regarding  buffer  availability  in  each  node.  The  information 
at  a  specific  destination  allows  a  source  node  to  control  the 
input-rate  directed  to  the  destination  node.  The  sum  of  the 
buffers  available  over  all  nodes  provides  an  indication  of 
network  congestion.  In  addition  to  the  overhead  of  passing 
flow  control  tables,  this  strategy  reflects  a  buffer 
availability  at  some  previous  time,  thus  limiting  the 
effectiveness  of  the  tables.  However,  as  in  the  centralized 
controller  strategy,  total  system  visibility  is  obtained. 

Gerla  proposed  a  global  windowing  scheme  as  an  improve- 
ment  to  the  previous  method,  in  which  each  source  node  has 
a  pool  of  numbers  to  each  destination  (or  group  of  destina¬ 
tions  in  the  same  region  or  subnetwork).  Each  packet  sent 
is  assigned  a  free  pool  number,  and  this  pool  number  is 
returned  to  the  pool  once  receipt  of  an  acknowledgement  from 
the  destination  node  has  been  obtained.  The  size  of  the 
pool  is  variable  and  can  be  adjusted  on  the  basis  of  flow 
control  table  information.  Unfortunately,  this  improvement 
is  limited  in  its  effectiveness  because  it  relies  upon  an 
acknowledgement  which  may  not  be  forthcoming  due  to  a 
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destination  subscriber  process  problem. 

3. 4. 1.4  Nodal  Buffer  Monopoly 

This  flow  control  strategy  attempts  to  exploit  the 
relationships  between  traffic  flow  on  input  and  output  ports 
(channels)  at  each  node  [42],  given  the  equilibrium  trans¬ 
mission  state  at  a  node,  for  which  T,  input  traffic  (1)  =  !: 
output  traffic  (0).  Due  to  nodal  buffering  (B)  and  traffic 
flow  fluctuations,  this  equilibrium  condition  is  seldom 
true.  However,  it  is  true  that 

'i  Jo1  -  Ej  Jo‘  °j(t)dt  -  B  (3'l) 

that  is,  at  any  point  in  time  all  information  can  be 
accounted  for  on  input/output  ports  i  and  j  respectively. 

The  state  of  a  node  can  be  represented  in  terms  of  the 
information  volume  transferred  via  an  input  port  and  its 
load  on  B  until  it  has  been  transmitted  out  over  the  various 
ports  j.  A  matrix  S  (Fig.  4)  can  be  used  to  represent  the 
state  where  each  is  the  load  on  B  caused  by  information 

flowing  internally  from  port  i  to  port  j  at  time  t.  Thus 
equation  3.1  can  be  re-expressed  as 

5:  i  j  S  i  j  ( t )  <  B  ,  i  n  wh  i  c  h  (3.2) 

any  row  vector  R .  (  t )  =  (S.^t),  Si2(t),  ....  Sip(t)) 

represents  the  instantaneous  load  on  B  contributed  by  input 
port  i.  Any  column  vector 
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Cj(t)  =  (Su(t),  S2J(t)  .  .  .  Snj(t» 

represents  the  i ns t a n t a neou s  information  volume  waiting  at 
port  j  to  be  transmitted  and  the  loading  on  B  while  waiting. 
With  this  knowledge  it  is  possible  to  observe  several 
different  types  of  buffer  monopolization.  For  example,  as 
vector  Cj(t)  approaches  B,  an  output  port  is  causing  a 
bottleneck.  As  R.(t)  approaches  B,  an  input  line  can  be 
found  to  be  the  cause  of  congestion.  One  port/port  informa¬ 
tion  path  can  be  found  to  monopolize  B  as  S  ^  -  ( t )  approaches 
B  . 

Buffer  monopolization  controls  for  each  of  these 
situations  can  be  determined  by  setting  limits  (threshold 
values)  for  the  vector  entries  R.(t),  C^(t)  and  S^j-  The 
primary  advantages  of  this  strategy  consists  of  its  ability 
to  (1)  push  back  deviations  as  they  are  detected  to  the 
source,  (2)  detect  and  identify  several  causes  of  nodal 
congestion,  and  (3)  eliminate  the  need  for  control  informa¬ 
tion  overhead.  However,  this  strategy  does  suffer  from 
frequency  of  update  overhead. 

3. 4. 1.5  Overflow  Detection 

Kahn  and  Crow  the r  [45]  describe  a  flow  mechanism,  used 
in  the  ARPANET,  which  insures  that  a  small  fraction  of  sub¬ 
scriber  traffic  is  always  capable  of  being  delivered.  The 
method  centers  on  two  overflow  buffers  maintained  in  each 
Interface  Message  Processor  (IMP).  When  information  flow 


is  at  a  virtual  standstill,  an  IMP  marks  a  packet  for 
delivery,  starting  the  overflow  process  .  The  overflow 
packet  passes  from  IMP  to  IMP  using  the  overflow  buffers 
in  each  IMP  until  it  reaches  its  destination.  This  strategy 
is  especially  useful  when  a  loop  exists  where  each  IMP  is 
saturated  with  traffic  bound  for  another  IMP  in  the  loop. 

3. 4. 1.6  Nodal  Limits 

This  strategy  is  prevalent  in  message  based  store-and- 
forward  systems  such  as  AUTODIN  (Department  of  Defense 
Automatic  Digital  Network).  Input  traffic  is  permitted  to 
enter  the  system  until  a  preset  storage  threshold  is  reached. 
Then  a  Wait  Before  Transmit  (WBT)  communications  protocol 
character  locks  out  any  further  input  of  local  subscriber 
traffic  until  the  traffic  load  subsides.  This  strategy  is 
computationally  simple  to  implement,  but  does  not  necessarily 
impact  the  source  of  the  congestion,  since  neighboring  nodes 
are  not  made  aware  of  the  problem. 

3. 4. 1.7  Node-Node  ARQ  (Automatic  Request  for  Repeat) 

Various  node-node  ARQ  schemes  are  used  in  store-and- 

forward  networks  to  insure  the  timely  and  error  free  flow 
from  subnet  node  to  node.  They  are  based  on  packet/message 
acknowledgement  (ack)  techniques  such  as  Stop-And-Wai t  ARQ, 
Continuous  ARQ,  Go-Back-N,  Selective  Retransmission,  Adaptive 
ARQ,  etc  [14],  The  proper  receipt  of  an  ack  permits  the 
sending  node  to  free  up  space  held  for  the  message  or  packet 
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and  assigns  delivery  responsibility  to  the  on-going  node. 

♦ 

To  minimize  the  delay  incurred  while  waiting  for  an  ack,  j 

several  techniques  have  been  implemented  to  better  utilize 
the  bandwidth.  Paramount  among  these  are 

(1)  "piggybacking"  acks  on  FOX  links, 

(2)  using  one  ack  for  a  group  of  packets  or  message 
segments  , 

(3)  responding  with  ne ga t i ve  -  a c ks  (NAK)'s  only. 

i 

3. 4. 1.8  Dedicated  Nodal  Buffers  I 

I 

A  nodal  dedicated  buffer  strategy  has  been  implemented 

in  the  ARPANET  to  preclude  direct  and  indirect  store-and- 

1  forward  lockups  [33].  Direct  s tore-and-forward  lockups 

occur  when  two  IMPs  are  each  saturated  with  packets  bound 

|  for  each  other.  An  indirect  store-and-forward  lockup 

!  involves  a  loop  of  IMPs  such  that  each  is  saturated  with 

I 

j  packets  for  another  IMP  in  the  cycle.  This  strategy  utilizes 

j  buffers  that  are  reserved  for  the  input/output  of  traffic. 

*;  A  reserved  output  buffer  guarantees  that  output  to  another 

I  1 

j  node  is  always  possible,  while  the  reserved  input  buffers 

.j  permit  each  node  to  always  be  able  to  inspect  incoming 

packets.  Although  this  strategy  was  contrived  to  correct 

« 

a  most  serious  ARPANET  problem,  the  strategy  also  has 
utility  for  whenever  these  types  of  lockups  occur. 

I 

1  3.4.2  Subscriber  Controlling 

|  Subscriber  controlling  flow  control  strategies  are 
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characterized  as  end-to-end  strategies,  where  the  end  points 
are  subscribers  or  the  entry/exit  servicing  subnet  nodes. 

3. 4. 2.1  Reservation  Schemes 

The  Request  For  Next  Message  (RFNM),  an  ARPANET  origina¬ 
ted  strategy,  permits  only  one  message  at  any  one  time  in 
transit  through  a  logical  (space)  subscriber-subscriber 
connection.  This  strategy  became  necessary  to  prevent  a 
"reassembly  lockup"  condition  at  the  destination  node  [45]. 
Reassembly  lockup  arises  when  a  number  of  partially 
reassembled  messages  (multiple  packets)  have  occupied  space 
in  a  destination  IMP.  Space  cannot  be  released  for  new 
packets  until  a  message  has  been  assembled  and  delivered  to 
the  subscriber.  This,  however,  is  not  possible  because  the 
packets  needed  are  held  up  in  the  network  waiting  for 
reassembly  space  in  the  destination  IMP.  The  use  of 
reassembly  buffers  as  a  mechanism  to  regulate  the  flow 
between  two  subscribers  requires  coordination  between  the 
source  and  destination  IMP  to  insure  sufficient  buffers  are 
available  for  this  transaction.  This  coordination  on  a 
per  message  basis  assures  that  a  single  link  cannot  cause 
network  congestion.  The  source  subscriber  cannot  send 
another  messaqe  to  that  destination  over  that  logical  link 
until  an  R 1 M M  is  received.  The  actual  connections  are 
functionally  like  circuit  switch  connections,  but  in  fact 
take  the  form  of  table  entries,  used  to  create  virtual 


circuits  from  one  subscriber  to  another. 
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The  National  Physical  Laboratory  (NPI )  uses  a  flow 
control  strategy  logically  similar  to  the  RFNM  reservation, 
yet  implemented  in  quite  a  different  manner  [13].  When  two 
subscriber  processes  in  the  NPL  network  wish  to  communicate, 
a  FOX  call  is  established.  Unlike  ARPANET,  calls  are  set 
up  using  special  message  types  (16  possible).  Flow  control 
is  achieved  by  requiring  that  messages  be  sent  only  if  a  go 
ahead  message  type  has  been  received  by  the  source 
subscriber.  Unlike  ARPANET,  several  messages  may  be  in 
transit. 

In  summary,  an  RFNM  type  strategy  does  regulate  flow 
control  and  prevent  reassembly  lockup,  but  at  the  expense 
of  bandwidth  reduction.  Additionally,  end  point  subscribers 
must  maintain  all  information  regarding  the  connection  to 
insure  smooth  flow  control. 

A  window  flow  control  strategy,  first  proposed  by  Cerf 
and  Kahn  [5],  can  be  used  in  conjunction  with  a  source 
subscriber  retransmission  capability  to  provide  considerable 
flexibility  for  buffer  allocation  schemes.  Basically,  each 
character  or  packet  has  associated  with  it  a  unique  sequence 
number  which  is  its  byte  location  relative  to  the  beginning 
of  a  data  stream.  Assume  that  this  sequence  number  is 
modulo  n.  A  flow  control  window  is  a  dynamic  range  within 
this  sequence  number  space.  The  window  edges  define  the 
window  range.  After  both  subscribers  are  synch ronized 
(similar  left  edges),  the  left  edge  of  the  window  plus  the 
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window  size  give  the  highest  sequence  number  (w)  that  can  be 
transmitted  (0  <  w  <  (n-1)).  With  this  strategy  the  receiver 
is  free  to  vary  the  window  size,  according  to  any  desired 
algorithm  as  long  as  the  window  size  never  exceeds  a 
threshold  which  would  cause  the  receiver  to  think  that  he 
is  receiving  a  new  message  [5].  As  long  as  arriving  packets 
are  within  the  window  range,  the  receiver  will  return  to 
the  sender  the  next  expected  sequence  number.  The  primary 
advantage  of  the  window  strategy  is  that  it  can  be  used  by 
both  source  and  destination  as  a  flexible  and  robust  tool 
for  tuning  the  data  flow  over  a  connection.  The  source  can 
"rush"  the  receiver  by  sending  packets  at  a  high  rate, 
subsequently  adjusting  the  window  to  the  rate  at  which 
acxnowl edgements  are  received  [2].  The  destination  on  the 
other  hand,  may  want  to  alter  the  window  size  to  reduce  the 
local  buffer  load.  The  destination  may  discard  a  packet, 
knowing  the  source  will  time-out  and  retransmit,  thus 
eliminating  out-of-sequence  problems.  A  major  requirement 
to  implement  this  strategy  is  a  source  retransmission 
capabi 1 i ty . 

3. 4. 2. 2  Crate  Occupancy 

A  pair  of  subscribers  that  desire  to  communicate  could 
each  at  the  outset  have  provided  a  prescribed  number  of 
buffers.  These  buffers  are  exchanged  using  the  mechanism 
of  crates  [45].  When  a  crate  arrives  at  one  subscriber,  it 
is  used  to  return  a  message.  As  long  as  crates  are 
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available,  flow  can  continue.  Thus  crate  availability 
regulates  traffic  flow.  Although  this  method  is  computation¬ 
ally  simple,  it  controls  congestion  on  a  subscriber- 
subscriber  basis  only,  and  does  not  insure  that  crates  are 
available  where  and  when  needed. 

3. 4. 2. 3  Subs c r i be r - Subs cr i be r 

Subscriber-subscriber  flow  controls  a  re  autonomous  from 
subnet  functions.  Once  a  physical  connection  is  established 
through  the  network,  the  subnet  appears  to  a  subscriber  as 
a  physical  private  circuit.  All  communications  between 
subscribers  require  some  knowledge  of  capabilities  exiting 
at  each  end  prior  to  connection  establishment.  Subscriber- 
subscriber  flow  control  strategies  have  traditionally  been 
used  primarily  in  circuit  switch  networks.  Some  store-and- 
forward  switched  networks  possess  a  circuit-switch 
capability  [85,  92]  with  limited  information  exchanges 
permitted  between  network  types.  Data  flow  control 
mechanisms  in  use  to  date  have  been  ad  hoc  designs  developed 
for  use  between  subscribers  with  common  interests.  Each  of 
these  mechanisms  support  to  varying  degrees  the  major 
responsibilities  of  error  and  delivery  controls,  data  link 
controls,  speed  conversion,  data  conversion,  record  keeping 
and  mode  of  operation  (half/full  duplex).  Although  the 
advent  of  the  microprocessor  provides  increased  flow 
control  capabilities,  the  implementations  to  date  of 
sub  sc  r  i  be  r- s  ubs  c  r  i  be  r  fow  mechanisms  fall  into  three 
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categories  : 

(1)  Circuit  Establishment 

(2)  Constant  Rate 

(3)  Pause  and  Go 

Circuit  establishment  mechanisms  ire  prevalent  in  a 
dial-up  mode  of  operation.  Each  subscriber  must  have  some 
minimal  knowledge  of  the  device  characteristics  at  the 
destination  end.  Typically,  the  subscriber  can  select  the 
baud  rate,  mode  of  operation  (half/full  duplex),  and  parity. 
Once  a  connection  is  made  in  dial-up  mode,  the  subscribers 
are  free  to  communicate  with  no  other  controls  applied. 
Typical  applications  of  this  mechanism  are  teletypewriter- 
teletypewriter  dialogues,  time-sharing  operations,  and 
facsimile  transmissions,  where  higher  error  rates  can  be 
tolerated.  Since  the  circuit  is  dedicated  for  the  duration, 
bandwidth  utilization  is  extremely  poor.  However,  this 
technique  is  very  economical  for  remote  user  support  in 
time  sharing  operations. 

Typical  applications  of  the  constant  rate  scheme  involve 
the  transmission  at  a  constant  speed  ever  a  circuit  switch 
connection  to  an  output  peripheral  frem  some  intelligent 
device  (i.e.,  computer  or  communications  controller  to  a 
teletype  like  device  or  printer)  [74].  Since  the  peripherals 
contain  minimal  logic  and  receive  only  at  a  hardwired  rate, 
they  cannot  influence  the  sender.  Some  error  flow  controls 
are  applied  to  signal  abnormal  conditions  (paper  shortage. 
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line  loss,  etc.).  For  the  most  part,  however,  the  output 
peripherals  rely  on  the  sending  device  for  any  flow  controls 
or  record  keeping. 

Pause  and  go  is  the  principle  technique  used  between 
subscribers,  when  accuracy  and  transmission  controls  are 
overriding  considerations.  With  the  wait  and  go  technique, 
the  sender  must  pause  after  transmitting  a  prescribed  number 
of  data  characters  until  receipt  of  a  go  ahead  control 
character.  This  process  is  then  repeated  [100].  Typical 
applications  of  this  technique  can  be  observed  in  data  base 
updates  from  a  remote  terminal,  or  a  magnetic  tape -magneti  c 
tape  data  exchange.  Since  accuracy  is  essential  for  these 
operations,  either  source  or  destination  can  initiate  wait 
commands  at  any  time.  All  data  storage  and  record  keeping 
may  be  uniquely  performed  by  either  subscriber  since  no 
flow  controls  govern  a  common  responsibility. 

3.5  Conclusions 

The  need  for  flow  controls  has  developed  as  a  result 
of  the  qrowth  in  re s ou r ce - s ha r i ng  s to  re  -  a nd - f o rwa rd  based 
networks.  Flow  control  mechanism  developments  have  been 
generally  ad  hoc  designed  and  tailored  for  specific 
implementations.  A  review  of  what  has  been  implemented  or 
proposed  enabled  classification  of  existing  mechanisms  into 
subnet  and  subscriber  controlling.  With  the  advent  of  the 
all  digital  network,  and  probable  integration  of  diverse 
subscriber  types,  flow  controls  have/and  will  become 
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increasingly  complex.  The  nodal  buffer  monoply  and 
windowinq  schemes  intuitively  appear  to  jointly  provide  the 
flexibility  and  robustness  needed  for  use  in  an  integrated 
network  and  will  be  examined  more  closely  in  the  network 
model.  Modern  micro-technology  development  makes  subscriber- 
subscriber  flow  control  strategies  cost  effective  as  an 
alternative  to  subnet  overhead  processing. 
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CHAPTER  IV 

THE  NETWORK  SIMULATION  MODEL 
4 .  Introduction 

The  model  developed  in  the  simulation  program  is  based 
on  an  integrated  packet/circuit  switched  network  consisting 
of  the  following  major  components:  (Fig.  5) 

A.  backbone  Circuit  Switch  (CS)  Nodes 

B.  Peripheral  Packet  Switches  (PS) 

C.  Invariant  Network  Synchronous  Time-Division- 
Multiplexed  (TDM)  Frame  Switching  Superstructure 

D.  Digital  Network  Using  T1  Carriers  and  Digital 
Switching  Nodes 

i.  Variable  Subscriber  Data  Rates 
1  .  Two  Classes  of  Subscriber  Traffic 

1.  Class  I  -  Real-time  traffic  that  once  started 
cannot  be  interrupted  (voice,  video,  facsimile, 
and  sensor) 

2.  Class  II  -  The  general  class  of  store-and- 
forward  (packet  based)  data,  such  as  inter¬ 
active,  query/response,  bulk,  and  narrative/ 
mes  ,  a  ge 

The  Backbone  CS  network  nodes  arid  peripheral  packet  switches 
form  the  nucleus  tor  a  distributed  compu  te  r- coinniun  i  ca  t  i  on 
network  in  which  the  transmission  of  data/voice  between  any 
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switching  superstructure.  Inis  1  orient,  treats  the  available 
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that  assumes  a  signalling  capability  exists.  Class  1 
subscribers  are  directly  terminated  to  circuit  switches 
to  preclude  packetizincj  arid  any  unnecessary  routing  overhead 
through  packet  switches.  Each  dial-up  Class  I  connection 
results  in  a  physical  subscriber -subscri ber  connection  for 
the  duration  o  f  t h e  call,  or  a  system  "loss’,  similar  to  a 
telephone  dial-up  process. 

Co-located  with  the  circuit  switch  nodes  (although  not 
a  design  requi renent )  are  packet  switches,  terminating  all 
Class  II  subscribers.  The  transmission  of  data  between  the 
packet  and  circuit  switches  is  accomplished  using  Time- 
Division-Multiplexing  on  the  network  side,  while  the  packet 
switch/subscriber  interface  is  dependent  upon  the  individual 
terminal  hardware  configurations. 

The  packet  switches  are  primarily  responsible  for 
management  of  packets  between  input  terminals  and  the  circuit 
switches,  placing  traffic  on  gueues  according  to  a  regional 
routing  policy,  and  performing  connection  initiation,  circuit 
disconnect,  and  coordination  with  other  packet  switches 
•'spending  on  the  system  leading. 

Traffic  flow  control  mechai  is. ns  are  used  between  either 
adjacent  nodes  or  on  an  end-to-end  basis  in  existing  packet- 
switched  based  networks.  'Jsjrg  the  packet  as  a  measure  of 
congestion,  the  developed  overhead  as  a  result  of  flow 
controls  severely  restricts  the  peak  bandwidth  that  is 
available  to  individual  users  [30,  1  b  ] . 


. ffer. -fcfagL..  .skMmw* 


53 


The  proposed  regional  routing  doctrine  for  each  packet 
switch  coupled  with  virtual  switch  connections,  reduces  this 
overhead  and  the  congestion  problem.  As  traffic  is  entered 
into  a  packet  switch  from  subscriber  terni  na  1  s>  ,  it  is  queued 
for  the  relevant  destination  packet  switch.  Unlike  the  S2NET 
scheme,  a  circuit  switch  connection  is  then  initiated/ 
terminated  by  the  packet  switch  or  behalf  of  this  traffic. 

A  circuit  switch  connection  can  be  established  for  a  single 
transaction  similar  to  an  interactive  communication,  or  on 
a  multiple  transaction  basis  if  the  traffic  is  bulk  data, 
me s s a ge / n a r ra t i ve  traffic,  or  several  users  queued  for  the 
same  destination  packet  switch.  This  routing  scheme  (1) 
insures  minimal  queue  build-up  within  the  backbone,  (2) 
enforces  an  end-to-end  flow  control  strategy,  and  (3) 
requires  responsive  link  flow  controls. 

deterministic  or  adaptive  routing  schemes  that  are 
currently  used  in  existing  pa  eke t/ c i rcu i t  switched  networks 
cr  hybrid  comb i e  1 1  i one  could  have  been  employed  within  the 
backbone  network  [36,  87],  Progressive  alternate  routing 
is  used  in  this  research  model.  With  this  method  each 
circuit  switch  node  has  a  primary  and  an  alternate  path.  If 
blocking  occurs  at  some  node  during  connection  initiation, 
the  alternate  mute  is  tried  for  route  completion.  If  this 
connection  fails,  the  transaction  is  either  queued  at  the 
packet,  node  or  considered  a  system  loss  at  the  circuit  node. 


do  in:  i!  dine  o  n  i  t  s  c  1  a  s  s  . 
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The  primary  qoal  of  this  research  model  is  to  provide  a 
tool  which  can  be  used  to  determine  the  system  flow  controls 
which  reduce  end-to-end  loss  probab i 1 i t i es  for  Class  I 
traffic  and  end-to-end  packet  delays  and  queues  for  packet 
switched  traffic,  qiven  variable  link  capacities,  dynamic 
frame  slots,  varyinq  packet  sizes  and  Voice  Diqitization 
Rates  ( VDR) . 

4.1  Description  of  the  Queueing  Model 

Whenever  applicable,  a  simple  analytic  model  that  yields 
precise  alqebraic  expressions  relating  system  inputs  and 
outputs  is  preferable  over  any  corresponding  simulation 
model.  for  the  integrated  comp u te r - commu n i ca t i on  network 
previously  described,  the  numerous  inter-nodal  conditions 
and  variables  preclude  any  exact  analytic  solution.  However, 
by  decomposing  the  network  into  nodal  queueing  models,  a 
significant  objective  is  the  verification  that  the  research 
model  output  can  be  represented  with  simpler  models. 

The  traffic  flow  at  each  packet  switch  is  described  as 
f  o 1 1 ow  s  : 

1.  Each  Class  II  subscriber  communicates  with  the 

packet  switch  via  independent,  Poisson  transaction 
arrivals  and  exponentially  distributed  transaction 
interarrival  t.  i  mes  . 

7.  The  message  lengths  (packets  per  transaction)  are 
assumed  to  he  geometrically  distributed.  This 
conforms  to  the  study  of  multiaccess  computer 
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communications  by  Fuchs  and  Jackson  [26], 

3.  Statements  (1)  and  (2)  imply  that  transactions 
arrive  at  the  packet  switch  independently  according 
to  an  exponential  interarrival  distribution  [64], 

4.  The  number  of  packets  that  arrive  at  the  packet 
switch  between  (any)  two  completed  transactions 
is  a  random  variable  with  geometric  distribution. 

5.  Each  packet  switch  can  be  thought  of  as  a  M/M/C 
system  (Kendall  notation)  [32],  with  infinite 

s  t  ora oe  . 

6.  Packets  are  placed  on  the  packet  switch  queue  and 
served  on  a  f i r s t- come - f i r s t - se r ved  (FCFS)  basis. 

The  traffic  flow  entering  each  circuit  switch  node 
originates  at  neighboring  circuit  switch  nodes,  connected 
packet  switch  nodes,  or  locally  terminated  Class  I  sub¬ 
scribers.  Since  all  traffic  entering  from  other  than 
terminated  subscribers  see  a  physical  connection,  it  does 
not  enter  into  a  serving  mechanism  process  at  the  circuit 
node.  The  locally  circuit  switch  terminated  subscribers 
are  assumed  to  possess  Poisson  arrival  and  exponential 
service  distributions.  Thus  the  M/M/C/C  queueing  model 
suffices  to  represent  this  network  model. 

Both  gueueing  models  are  impacted  bv  channel  avail¬ 
ability.  To  accomplish  the  time  slotting  of  the  frame  at 
each  circuit  switch  node,  the  literature  [10,  21,  60,  83] 
promotes  the  use  of  an  operating  rule  that  allows  subscribers 
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access  to  the  system  using  a  "gate"  concept  demand  from 
queueing  theory  [95].  The  gate  is  assumed  to  be  open  at 
certain  time  intervals  to  Class  I  or  Class  II  data.  This 
is  done  to  insure  a  minimum  grade  of  service.  Tor  the 
research  model,  the  frame  boundary  is  "floated",  thereby 
keeping  the  gate  open  all  the  time.  This  forces  Class  I 
and  II  subscribers  to  compete  for  available  slots. 

In  summary,  delays  and  queues  at  each  node  are 
approximated  closely  by  M/M/C/“>  and  M/M/C/C  queueing  models 
(Fig.  7).  Since  each  of  these  models  is  globally  impacted 
by  channel  availability,  the  network  simulation  provides 
performance  measures  for  end-to-end  delay  and  blocking  with 
relevant  flow  parameters  applied. 

4.2  Overview  of  the  Simulator 

The  creation  of  a  program  model  implies  a  two-step 
procedure  of  (1)  detailing  a  logical  description  of  the 
system  to  be  modeled  and  (2)  programming  and  testing  that 
model  . 

The  logical  description  of  the  program  model  is  closely 
related  to  the  usage  of  a  symbolic  lanquage  to  give  a 
compressed  yet  correct  description  of  the  studied  system. 
Since  the  construction  of  the  appropriate  model  is  an 
essential  part  of  systems  analysis,  it  is  useful  to  dis¬ 
tinguish  between  the  different  types  of  models  available  to 
the  analyst.  Imshoft  [17]  classifies  models  into  four  major 
types  (descriptive,  physical,  symbolic,  and  procedural) 
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comparinq  their  usefulness  with  such  factors  as  ease  of 
communications  between  technical  and  non - 1 ech n i c a  1  personnel, 
the  relative  cost  of  using  such  models,  and  the  associated 
limitations  for  each.  Of  these  four  types,  the  symbolic  and 
procedural  models  offer  the  greatest  potential  for  data 
communications  oriented  problems.  A  symbolic  (mathematical) 
model  is  an  efficient  tool  where  explicitly  stated  concise 
mathematical  expressions  can  be  formulated.  For  those  data 
communications  systems  which  are  event  driven  by  real-time 
requirements,  it  is  difficult  to  quantify,  using  analytical 
methods,  the  dynamic  re  1  a t i onsh i ps  which  exist  among  numerous 
system  variables.  instead,  the  use  of  procedural  (simula¬ 
tion)  models  becomes  necessary  to  express  the  dynamic 
relationships  hypothesized  to  exist  in  the  real  worlG 
situation,  by  means  of  a  series  of  elementary  operations  on 
appropriate  variables.  These  elementary  operations  are 
typically  represented  by  use  oi  a  computer  program. 

Formal  computer  languages  have  many  characteristics. 

The  relative  importance  of  these  characteristics  depend  on 
such  Factors  as  a v a  i  1  a b  i  I  i ty ,  ease  of  programming,  diagnostic 
capability,  applicability  to  a  wide  range  of  problems,  and 
one  that  facilitates  model  formulation.  Althouqh  there  are 
a  number  of  high  level  program  using  languages  especially 
designed  for  discrete  system  simulation,  such  as  GPSS,  GASP, 
SOI.  ,  SUBSCRIPT  [  1  7  j  ,  the  FORTRAN  ianquago  was  selected  for 
development  of  the  model  because  in  addition  to  possessing 
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these  features,  it  was  readily  available  on  both  the  local 
Amdahl  470  and  the  Data  General  Nova  Series  computers  as 
well  as  other  m i n i comou te r s . 

Since  the  communications  activity  was  centered  around 
nodal  activity,  the  model  was  node  bused.  There  are  three 
principle  nodal  tables  -  routing,  channel,  and  queue  tables. 
The  routing  table  is  used  to  determine  the  output  channel  a 
transaction  wi 11  take  throuqn  the  node  to  reach  its  destina¬ 
tion.  This  table  is  created  in  the  initialization  phase  of 
the  program.  fach  channel  table  is  sized  for  maximum  voice 
channel  allocations.  Varying  a  system  parameter  increases/ 
decreases  these  allocations.  Since  each  connection  is  FDX, 
two  indices,  representing  sender  and  receiver,  are  required, 
and  each  connection  is  modeled  by  two  indepenaent  channels. 
Information  stored  and  updated  within  various  channel  table 
entries  at  each  node  is  used  in  the  gathering  of  statistics. 
The  queue  tables  at  each  node  are  used  to  obtain  statistics 
associated  with  average  transaction  time  in  the  system, 
utilization  of  the  channels,  and  various  transaction  oriented 
delay  statistics. 

An  event  table  reflects  network  status  disturbing 
events.  lor  example,  an  event  table  entry  may  contain  the 
time  of  the  next  arrival  or  departure  at  a  node.  The 
simulation  is  driven  by  event  changes  that  occur’  at  each 


node  . 
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4.3  Properties  of  the  Model 

The  model  is  partitioned  into  functional  modules.  Lach 
such  module  consists  of  a  number  of  event  routines  or 
subroutines.  The  driver  module  is  scheduled  from  input 
parameters.  All  other  routines  are  scheduled  by  the  research 
model  itself. 

4.3.1  Operation  Characteristics 

Tor  a  10-node  network  the  compiled  object  program 
occupies  30K  bytes  and  the  associated  table  and  work  area: 
require  storage  based  on  network  sizing.  The  computer  run¬ 
ning  time  is  simulated  by  nodal  event  occurrences  for  a 
period  of  time  as  specified  by  the  user  input  system 
parameters  during  the  ini tia  I  ization  phase.  Steady  state 
is  assumed  when  a  node  reaches  a  usei  provided  packet 
saturation  level  or  end  run  time.  At  this  time  channel  and 
queue  statistics  are  collected.  Although  each  computer  rin 
is  based  on  a  user  supplied  end  time,  it  was  felt  that 
several  minutes  (8)  of  nodal  simulation  permitted  sufficient 
statistics  to  be  obtained.  The  main  program  consists  of  a 
tight  DO  Loop,  calling  the  event  module  until  the  end  time 
is  reached,  at  which  time  output  statistics  are  printed, 
followed  by  run  term i na t  i on  . 

4.3.2  Description  of  functional  Modules 

The  major  modules  of  the  research  model  are: 

( 1 )  initialization 


(2)  Transaction  Generation 

( 3 )  Arrival 
( 4  )  Rou  t i nq 
(5)  Departure 

(  6  )  Event  Selection 

(7)  Statistical  Gathering  and  Output 

4 . 3 . 2  .  1  Initialization 

.'his  module  has  a  twofold  objective:  (1)  to  build 
tables  accordinq  to  user  input  parameters,  and  (2)  to 
initialize  table  areas  at  the  beginning  cf  the  run  and 
initialize  several  table  statistic  entries  when  steady- state 
is  reached.  Ihese  objectives  are  accomplished  within  the 
N: WMSG  subroutine  and  the  READ  statements  of  the  main 
P rv ']  ram  . 

4. 3.2.2  Transaction  Generation 

This  module  is  comprised  of  subroutines  NEWMSG,  POISSON, 
C.F0M,  and  RANDOM.  Eacli  call  to  the  generation  module  results 
ir'  an  arrival  containing  the  length,  destination  number,  and 
arrival  and  departure  times  of  a  t ransac t i on .  The  arrival 
information  is  then  placed  in  an  available  queue  location. 

4.3.2. 3  A r  r i v  a  1 

Tiie  an  iviil  of  a  transaction  at  a  node  is  a  status 
disturbing  event.  The  arrival  module  is  responsible  for: 

(1)  Determining  whether  the  new  arrival  requires  a 
route  or  ca:i  be  placed  directly  on  an  existing 
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channel  queue. 

(2)  Initiating  a  route  through  the  network,  if 
required. 

(3)  Updating  channel  routing  tables  at  all  affected 
nodes  . 

(4)  Calculating  the  time  this  transaction  would  depart 
the  system  and  recording  this  in  all  affected 
channel  tabl es  . 

(5)  Determining  queueing  delays  and  updating  nodal 
delay  tables. 

(6)  Generating  the  next  arrival  at  this  node. 

(7)  Updating  the  system  clock. 

Subroutines  required  to  accomplish  these  goals  are 
ARRIVE  ,  IMPROV  ,  and  UPDATE  . 

4. 3.2.4  Routing 

This  module  is  responsible  for  initiating  and  termin¬ 
ating  a  EDX  route  from  source  to  destination  through  the 
network.  Passed  to  this  module  are  source  and  destination 
arguments.  Since  the  ROUTE  subroutine  has  knowledge  of  end 
points,  it  searches  routing  tables  in  a  prescribed  manner 
to  derive  a  route.  Ihe  variable  IYESNO  indicates  the  status 
of  the  mute  search.  Cnee  a  path  is  found  three,  h  the 
network  (IYESNO-O),  routine  UPDATE  is  called  to  actually 
construct  the  path  and  update  channel  table  entries  at 
affected  nodes.  If  no  path  can  be  found  (  I  Y  E  S  d  0  = 1  )  ,  a 
failure  indication  is  returned  to  the  calling  module. 
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U  s  i  n  q  source  and  destination  nodes,  the  output  channel  at 
each  node  is  identified  via  a  (JIANIli  table  look-up.  Lath 
intermediate  node  is  then  accessed  using  the  appropriate 
output  channel.  In  this  manner  eao h  node  is  accessed  and 
channel  and  queue  purging  accomplished. 

4  .  3 . 2 . 5  De  pa  r  t  u  re 

The  departure  of  a  transaction  from  a  node  is  a  status 
disturbing  event.  The  departure  module  has  the  followinu 
primary  responsibi 1 i ties: 

(1)  Terminating  the  route  through  the  network. 

(?)  Updating  channel  table  and  queue  entries  for  each 
affected  node. 

(3)  Updatinq  the  system  clock. 

The  subroutines  required  to  perform  these  departure 
functions  are  Of  PART  and  REMOVE  . 

4.3.13.6  Event  Selection 

lhi>  event,  ‘.election  module  is  responsible  for  (1) 
obtaining  the  next  event  at  a  node  and  placing  it  in  the 
node  event  table,  and  (?)  selecting  the  next  event  and 
calling  the  appropriate  servicing  module.  Nodal  arrival 
and  departure  queues  are  searched  for  the  earliest  event 
in  <  urri'iu  i'  by  subroutine  N III  VN  I  .  Info rmu  t  i  on  related  t  o 
the  event  is  then  plated  in  the  event  table. 

The  event  table  is  scanned  by  subroutine  EVENT  for  the 
next,  event  in  time  to  be  serviced  and  a  branch  made  to  the 
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appropr’ite  servicing  module  using  a  (fiMPDIII)  uDTO  statement. 

4.  i.?.7  Statistical  Gathering  and  Output 

lhis  module  uses  the  arc  umuluted  channel  and  ()ueue  data 
to  output,  statistics  re  „ting  to  channel  and  node  usage. 
Included  in  the  statistical  output  art  a  summary  of  traffic 
flow  thru  iqh  each  node,  includin'!  channel  utilization, 
packet  delays,  voice  blocking,  slot  utilization,  and  nodal 
loading.  Subroutine  STATS  provides  the  output  information 
while  subroutines  II  I' DAT!  ,  AH  R I  VI",  L|PART,  and  IMP  Ml  V  update 
channel  and  queue  tables. 

4.4  Description  of  Major  Tables 

The  fol  lowimi  tables  are  necessary  to  integrate  the 
tunc t i on  a  1  modu los: 

1.  Parameter  (  1 1 A R AM)  [X] 

I  vent  (  I  V  1 1;  I  )  [Node,  1  n  L  r  y  J 
i .  Destination  (DISTAli)  [Node,  Dest] 

4  .  I.  h  a  nni*  I  (  C  HAN  I  Ii  )  [  (.  ii  a  n  no  I  ,  I  n  t  r  y  ] 

S.  t.'ueur  (ObfL'i  )  [Node,  iut^vl 

n  .  S  1  11  Ou  -ue  ('.All'))  |  1  r  ruin  ,  I  n  t  r  v  1 

/.  tump  lii  'vo  lime  ((.DMIIM  )  [No  it-,  Irtrvj 

fill'  A  i  t  e  p  t  e  ‘t /  Re  j  e  i  1 1>  '*  {  '  I  I  v  )  t  1  ne  do  ,  1"  n  t  r  v  J 

"  .  lint  (I  !  N  i  1  P,  1  |  NoOc  ,  Dos  *  | 

I  ti  .  S  e 'Mi  (  ,  I  :  1 1 1  H  ;  [Node,  [  i  i  .  t  i  i  D  u  t  i  j  n  ] 

II.  lino  f  v  ,i  i  I  .•  b  i  l  i  t  v  /  'I  I  :  N '  S  )  [  1  n  uitu‘1  ] 

I  ?  .  i  ii i  <mi  o  i  n  t  r  v  (min*  (  ijt  t;  I  )  [  No  do  | 
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CHAPTER  V 

ANALYTIC  DEVELOPMENT  OF  AN  INTEGRATED  MODEL 

S  .  I  n  t  r  o  d  u  c ■  t  i  o  n 

The  integrated  network  can  be  decomposed  into  multiple 
nodal  configurations,  each  comprised  of  two  exponential 
arrival  processes  competing  for  a  fixed  number  of  common 
time  slot  allocations  (channels).  The  arrival  process  to 
the  channels  is  a  Poisson  stream  of  transactions  with  mean 
arrival  rates  •  ^  and  • ^  respectively.  Similarly,  the  service 
times  are  mutually  independent,  negative  e x pone n t i a  1 1 y 
distributed  random  variables  with  mean  service  rates  u-|  and 
. 2  ■  0  respectively.  A  Class  I  transaction  that  finds  all 
channels  busy  departs  the  system  and  is  considered  a  system 
loss.  A  Class  II  transaction  that  finds  all  channels  busy 
joins  the  queue  and  remains  there  until  served. 

!m h  nodal  system  is  modeled  as  a  Markov  process  with 
state  space  I ,  where  I  is  defined  by 

1  !  (  ri  ,  m )  ;  n  0  ,  1  ,  .  .  .  ,  t,  ;  m  0  ,  1  ,  . 

The  steady-state  probability  that  m  (lass  I  transactions  and 
n  (  I dv,  II  transaitions  are  in  the  system  (the  system 
i  o  n  s  i  s  t  s  of  all  ■  h  i  n  rie  I  s  and  t  h  e  queue  of  (lass  II  transac¬ 
tions,  if  an/)  is  denoted  by  p  .  lor  r.  o  t.  a  t  i  o  n  a  1  simplicity 
the  v  im  t ii  r  of  s  I  I'liil  y  •  s  t  a  tc  |i  r  o  b  a  b  i  I  i  t  I  .  ,  1 '  ,  is  in 

'  >•  ■  i  i  n  'I  r  a  ph  i  i  older  and  is  partitioned  as  (  P  ,  P  j  ,  .  .  .  )  , 


6  7 


where  Pj  -  (Pjq,  Pj  1  ’  '  '  '  ’  P  j  C  ^  Por  J  0-  ■  •  •  • 

Using  the  traditional  methods  of  Markov  processes  [32], 
the  steady -  state  probabilities  are  the  solution  to 

Pr  -  0 
C 

and  '  p .  .  1  , 

i  0  j=0  J 

where  :  is  the  matrix  of  transition  rates.  Fig.  8  depicts 
a  rate  matrix  for  a  three  channel  system. 

The  rate  matrix  r  can  be  structured  as  a  block  tri- 
di  agonal  form.  Wong,  Disney  and  Giffin  [96]  developed  a 
solution  technique  for  a  queueing  system  whose  rate  matrix 
has  a  similar  block  tri -  diagonal  form.  Their  work  is  not 
directly  applicable  to  the  nodal  model  for  two  reasons: 

(1)  They  assumed  a  finite  queueing  capacity,  and 

(2)  Their  solution  depended  on  the  sub-diagonal 
partitioned  matrix  being  non-singular. 

In  contrast,  the  nodal  model  allows  data  queues  to  form  when 
all  channels  are  filled  with  voice  or  data.  Additionally, 
it  is  necessary  to  rotate  the  last  column  of  each  channel 
group  circularly  to  the  left  one  group  to  preclude  singular 
s  u  b  -  d i a  go n  a  1  partitioned  ma  trices. 

[he  (jori  1  of  the  algorithm  developed  herein  is  to  obtain 
s  tea  d  v- s f  a  t  >■  probabilities  for  the  number  of  Class  I/ll 
I  t  a  n  s  a  e  t  i  on  ■.  w  i  t  hi  n  a  nodal  system.  A  large  rate  matrix, 

( (.  t  I  )  *  * ,'  »  (:<  I  )**,-•.  i  48  and  upwards,  is  required  to  obtain 

■  t c a d y  -  s t a t e  solution  for  the  nodal  model.  Clearly,  for 
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Fig.  8.  Rate  matrix  for  three  channel  system 
channel  channel 
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large  nodal  models,  conventional  Gaussian  matrix  solution 
techniques  become  prohibitive. 

The  algorithm  formulated  by  this  procedure  is  computa¬ 
tionally  tractable.  Closely  related  to  Wongs,  et  al  work 
[96],  a  matrix  operator  8  is  defined  and  steady -state  data 
queue  length  distribution  obtained  in  terms  of  its  eigen¬ 
values  and  eigenvectors.  The  Pq  probability  vector  is 
determined  by  Gaussian  solution  of  a  C+l  system  of  equa¬ 
tions.  All  other  probability  vectors  are  iteratively 
expressed  in  terms  of  Pq,  and  the  resulting  probabilities 
normed.  Measures  of  effectiveness  such  as  expected  number 
of  data/voice  transactions  in  the  system  or  queue, 
probability  of  all  channels  occupied  by  voice,  etc.,  are 
then  derived  using  the  probability  distribution.  The 
algorithm  is  implemented  by  a  FORT  RAN  computer  program  that 
requires  at  most  (2C+2)*(2C+2)  matrices  for  its  calculations. 

6.1  Solution  Process 

The  solution  process  decomposes  the  rate  matrix  r  into 
several  submatrices  (Mg.  9).  Each  submatrix  is  (C  +  1)*(C  +  1) 
and  defined  as  follows: 
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Four  major  steps,  each  requiring  development  and  verification 
of  a  computer  program,  are  necessary  to  complete  the  solution 
process.  These  steps  are: 

(a)  Algorithm  Development 

(b)  Pq  Vector  Determination 

(c)  Steady-State  P  Vector  Determination 

(d)  Determination  of  Effectiveness  Measures 

5.1.1  Algorithm  Development 

By  multiplying  the  rate  matrix  with  P  vectors,  the 
following  equations  result: 


poAo  + 

piMr° 

(5. 

,1) 

Pn-1A 

+  PnAn  = 

Pn+1 Mn+1 = 

0,  n=l ,  .  . 

.  ,  C  - 1 

(5. 

•  2) 

Pn-1A 

+  PnAC  + 

Pn+lV0’ 

n»C  ,  C+  1  ,  . 

N-2 

(5. 

•  3) 

Pn  -2A 

+  Pn -  1 Ac 

+  pnM'=0, 

n=N-  1 

(5, 

•  4) 

P0Q  +  Pn 

-1A  +  V 

\c=0,  n=N 

(5. 

■  5) 

Equation  5.3  can  be  rewritten  as: 

pn+ 1  =  pnH  1  +  P  n  -  1  H  2  ’  n  =  C’  C  +  1 . N'2  (5.6) 

where  -A^M^  dnd  = 

Let  X  -  ( p  ,  P  , ) ,  n -  0  ,  1  ,  2  ,  .  .  . 

n  n  n+ 1 

Define  a  matrix  operator  B  ( 2C  +  2)  *( 2C  +  2 )  partitioned  as 
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0  H 


I  H. 


Then 

from 

5  •  6  *  xn  +  1  =  xn6,  for  n=C 

Now 

XC 

X 

o 

1 

03 

XC  +  1 

:  xc-ib2 

XC  +  k 

=  XC-lBk+1 *  for  k=0»  1 .  2, 

XN-1 

-  x  rn-C 

-  XC_]B 

.  ,  N-2 


(5.7) 


0  -AM' 


Let  Gn  =  be  a  (  2C  +  2  )  *  ( 2C  +  2  )  operator, 

j  « jv|  ~  ^ 

n  n+1  where  n=0,  1,  .  .  .  c-2 

Rewriting  equation  5.2  results  in: 


Pn*l  ’ 


V ( Pntj >  P„,2)  ■  <P„,  P„.,)G 


n’  n+l '  n+1 


Then  X]  =  XqG1 


*2  '  X1G2  =  X0GIG2 


X0G1G2  •  • 
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Using  5.7  in  combination  with  the  preceeding  results  in 


xc  =  X0G1  •  ■ 

•  Gc-1B 

XC  +  1 

=  X0G1  • 

.  .  GC|B2 

X N  -  2  "  X0G1  • 

r  rN-C 

.  .  GC.1B 

*  X 

•  •  N-1 

X 

O 

cr 

.  .  G  bN-Cr 

C  -  l  B 

where  B  is  formed  similarly  to  B  except  M  replaces  in 
the  calculation  of  H 1  and  H  2  . 

Now  from  5.1: 

<0  '  <V  V  =  <V  -posoni,)  ■  P0(I'  -Vl'1 

.•.*1.-1  '  Po(  1  •  -Vi'1  h  ■  ■  ■  Gc..BN-Cb'.  (5.8) 

Because  equation  5.5  is  redundant  delete  it. 


Thus  .  ^  ^  t  +  11 


*  <pN-r  V 


- -  -> 


v  N  - 1 


0 


(5.9) 
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Now  combining  5.8  and  5.9  results  in 


v-  -v;'»  ci  •  •  •  gc-ibN'v 


=  0  (5.10) 


In  essence,  the  solut  on  to  equations  5.1  -  5.5  in 
t‘*rms  of  5  .  Iff  comprise  the  alqoritfim  development. 


5.1.?  Py  Vector  lie  te  rm  i  n  a  t  i  on 

The  P  Vector  is  determired  by  a  computer  program  that 
implement’  equation  6.10.  The  validity  of  the  computer 
program  was  checked  hv  implementing  a  small  system  (03)  and 
verifying  the  solution  by  another  computer  program  that 
solved  the  system  using  Gaussian  elimination. 


6.1.3  S  t  e  a  dy  -  5 1  a  t.  e  P  Vector  De  te  rm  i  n  a  t  i  on 

The  de t e rm i n a t i o n  of  P  vectors  Pg,  P^,  .  .  .  ,  P^ 

require0  the  development  of  an  efficient  technique  to 


r  a  1  c  u  1  a  t  e  mu  t  r  i  x  B 


The  technic) ue  utilized  is  based  on 


Wong's  work  [96J  that  determines  through  a  similarity 
transformation  R  -  PJR  ^  ,  where  R  and  R  ^  are  non-singular 
matric.es  and  J  a  matrix  of  distinct  eigenvalues. 

lemma:  The  charac teri s t i c  matrix  of  B,  B(z),  has  the 

same  eigenvalues  as  those  of  a  reduced  z-matrix  D(z)  [96J. 
Proof:  The  r ha r a c te r i s t i c  matrix  for  B  is 


(  /  )  (  /  I  H  ) 


"-"i 


where  D  (  z  )  il \ (5.11) 
and  is  dimensioned  (C+T  }*(C  +  1  )  . 


.  .  the  charac.  teristic  polynomial  of  B  (  z  )  and  0  (  z  )  is 
identical . 


Now  H i  can  be  expressed  as 


k 


Ihe  eiqenvrilui",  are  obtained  by  solving  each  quadratic 
equation.  By  inspection,  t  h  e  e  i  q  e  n  v  a  1  u  e  s  in  the  last 
diagonal  entry  are  /  0  and  i  -■  ^  )  .  The  eigenvalues 

in  the  kth  position  on  the  diagonal  are  determined  by 
solving  the  general  equation: 
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results  in: 


R1J0+H1R3J0  =  R3J0 


R3J0-H1R3J0-H2R3  0 


Now  since  J  is  in  reality  eigenvalues  z,  and  by  looking  at 
the  kth  column 


(zkI_zkHl'H2)R3,k  ~  0 
or  D(zk)R3,k  =  0 


For  notational  simplicity  represent  D  ( zk  )  as 


D<zk>  " 


dl  d2 


dC  dC+l 


where  d,d  equate  to  previously  defined  D(z)  elements, 


Now  eigenvector  k 


'lOJfft**  -X 


where  z^  varies  over  eigenvalues  in  Jq. 


Then 


rl,k  =  r2 ,  k  *  •  ’  *  =  Vl,k  =  0 

where  t  is  the  index  of  the  row  whose  eigenvalue  gave 

V 


Let  r.  ,  =  1  and  r„  .  =  -d„r  ,/d„  for  all  n>*. 

£ ,  k  n,k  nn-l  n 

Thus  eigenvector  R^  elements  can  be  determined,  and  likewise 
from  5.16 


WlVl  =  V?  ===^>ukI‘zkHrH2)R4,k  ■  °- 

The  same  iteration  scheme  (varying  z^  over  J.  eigenvalues) 
gives  eigenvector  R^ . 

After  building  R3  and  R^,  equations  5.14  and  5.16  are 
used  to  build  R^  and 

To  avoid  calculating  S~  ,  matrix  S  is  calculated 
iteratively  similar  to  R.  Pre-mul ti plyi ng  each  side  of 


B  =  RJ  S  by 

S  results 

i  n 

SB  = 

JS  decomposed 

as 

S1 

S2 

0 

H2 

J0 

0 

S1  S2 

S3 

S4 

I 

H1 

0 

J1 

S3  S4 

where  S. 

=  (S4 

1 

.  s, 

9  » 

.  S, 

r  j.  l  ) 

* 

1  « 
CSJ 

II 

The  following  equations  can  then  be  derived 
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$4  ~  ^ 1 ^4  (5.19) 

S3H2+S4H1  =  J1S4  (5'20) 

Substituting  5.17  and  5.18  results  in 

si  ,k(2k-2kHrH2)  •  0  si ,kD<2k>  "  °- 

Using  an  iterative  procedure  similar  to  that  employed  to 
build  and  R^,  row  elements  of  Sj  and  S3  are  determined. 
Equations  5.17  and  5.19  are  used  to  calculate  and  S  ^ 
elements.  Since  each  row  of  S  represents  some  multiplicity 
of  each  corresponding  eigenvalue,  it  is  necessary  to  compute 
I  =  R S  and  divide  S  by  the  resultant  diagonal  elements  of  I 
to  obtain  a  true  S.  Upon  completing  this  portion  of  the 
software,  all  probability  vectors  needed  for  steady-state 
representation  are  obtained  using  equations  5.1  -  5.5. 

These  probability  vectors  are  then  normed  forming  a 
probability  distribution. 

5.2  Determination  of  Effectiveness  Measures 

The  following  steady-state  effectiveness  measures  are 
considered  relevant: 

(1)  Number  of  data  transactions  in  the  system 

(2)  Number  of  data  transactions  in  the  queue 

(3)  Number  of  voice  calls  in  the  system 

(4)  Probability  of  all  channels  busy  with  voice  calls 

(5)  Expectation  of  data  transaction  in  the  system 
given  all  channels  busy  with  voice 


4  'H»in»ii|tfmi.i 
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(6)  Probability  of  all  channels  almost  full  with  voice 
calls 

(7)  Expectation  of  data  transactions  in  the  system 
given  all  channels  almost  full  with  voice  calls. 

These  measures  are  obtained  from  the  steady-state 
probability  distribution  for  the  system  [32]: 

N  C 


LData  =  z  n  £  P 
n=0  m=0 


n  ,m 


Data 


C  N 

=  r  z 

m=0  n*C-m 


[n-(C-m)]  P 


n  ,m 


LVoice  =  £ 
m=0 

N 

P{m=C }  =  £  I 
n  =  0 

N 

E[n|m  =  C]  =  r. 

n^O 

N 

P(m>C-2)  =  £ 

n  =  0 


n  =  0 


n  ,m 


n  ,C 


N 


nP  r  Z  P _  r 

n’C  n=0  n,c 


Pn ,C -2  +  Pn  ,C -1 +Pn  ,C 


N  n[P_  _  ,+P„  r  ,+Pn  r] 
E[n | m  C-2]  =  z  n,C-2  n,C-1  n,C 


(5.21) 

(5.22) 

(5.23) 

(5.24) 

(5.25) 

(5.26) 

(5.27) 


n  =  0  N 

Z  P 
n  =  0 


n,C-2+Pn,C-l+Pn,C 


5.3  Conclusions 

The  development  of  computationally  tractable  computer- 
communication  network  mathematical  models  is  difficult  due 
to  numerous  network  variables  and  assumptions  [36].  Used 


^  if 


§ 

i 


in  conjunction  with  the  network  simulator,  computer 
implementation  of  the  model  developed  herein  provides  useful 
steady-state  effectiveness  measures,  which  can  be  used  to 
confirm  simulation  output  or  provide  bounds  on  simulation 
expectations.  It  is  implemented  by  a  highly  portable 
FORTRAN  computer  program. 


mamem  ir. 
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CHAPTER  VI 

DEVELOPMENT  OF  AN  INTEGRATED  FLOW  CONTROL  SCHEME 

6.  The  Need  For  a  Flow  Control  Scheme 

The  statistical  analysis  (Figs.  15-20  and  Appendix  E 
tables)  indicates  that  controls  are  necessary  to  manage 
nodal  activity  at  the  packet  nodes.  With  no  flow  controls 
other  than  those  generated  by  varying  system  parameters, 

Fig.  15  shows  that  subscriber  packet  delays  become 
significant.  Although  the  model  does  not  test  for  abnormal 
network  situations  such  as  path  failures,  subscriber 
malfunctions,  etc.,  they  clearly  contribute  further  to  the 
problem.  Analogous  to  a  s tore-and- forward  network,  controls 
over  packet  nodal  s to  rage  and  subscriber  activity  in  an 
integrated  system  are  required.  Independent  of  any  control 
intelligence  within  the  subscriber  environment  or  circuit 
switch  blocking  factors,  packet  switch  loads  must  be 
regulated . 

6.1  Utility  of  Existing  Strategies 

The  model  design  is  based  on  an  underlying  circuit¬ 
switching  structure.  All  flow  control  layers  are  maintained; 
however,  the  subnet-subnet  and  subnet-subscriber  layers  are 
utilized  only  during  the  routing  process  or  abnormal  network 
conditions.  This  situation  exists  because  subnet  nodes 
permit  no  data  queues  and  exercise  limited  network  control. 


'  it's- n-f-i 


V 
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The  lack  of  sophistication  in  these  layers  eliminates  as 
potential  solution  techniques  all  subnet  controlling 
strategies  except  nodal  limits  and  nodal  buffer  monopoly. 
These  strategies  are  node  controlling  and  not  dependent  on 
nodal  coordination  or  interplay.  Within  the  subscriber- 
subscriber  flow  layer,  all  subscriber  controlling  strategies 
but  the  window  scheme  are  elininated  as  potential  solution 
techniques.  Only  the  window  strategy  possesses  the  flexi¬ 
bility  for  controlling  link  bandwidth  and  subscriber- 
subscriber  communications. 

6.2  A  Ring  Control  Scheme  Proposal 

Packets  are  assumed  to  contain  only  routing  and/or 
subscriber  coordination  information;  thus,  a  network  flow 
control  scheme  based  on  packet  composition  is  not  considered. 

The  subscriber-subscriber  flow  control  layer  is  directly 
involved  with  subscriber  process  multiplexing/demultiplexing 
and  storage  availability.  The  framework  for  an  integrated 
flow  control  scheme  consists  of  requ i remen t -ca pab i 1 i ty 
matching  between  this  layer  and  nodal  limit,  nodal  buffer 
monopoly,  and  window  strategies.  A  flow  control  hierarchy 
can  be  constructed  consisting  of  the  following  strategy 
rings  (Fig.  10): 


• 

• 

(a) 
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Limits  Ring 

(b) 
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10.  Flow  control  ring  scheme 
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6.2.1  Nodal  Limits  Ring 

Foremost  is  the  requirement  that  a  node  not  become 
saturated.  The  nodal  limits  strategy  ring  insures  the  node 
will  not  become  overloaded.  This  is  accomplished  by  reject¬ 
ing  input  packets  when  a  nodal  threshold  is  exceeded.  The 
rejection  process  consists  of  discarding  all  packets  received 
above  a  prescribed  nodal  limit  knowing  that  the  window 
strategy  ring  will  subsequently  detect  an  out-of-order 
packet  condition  and  effect  subscriber  controls. 

6.2.2  Nodal  Monopoly  King 

This  control  ring  monitors  all  s ubs cr i be r- 1 i nk  flow 
connections  using  a  buffer  monopoly  matrix  whose  rows  and 
columns  represent  subscriber  and  link  loadings  respectively. 
With  a  monopoly  matrix  three  flow  rates  can  be  monitored: 

(1)  Subscriber  Buffer  Load 

( 2  )  Channel  loading 

(3)  Subscriber-Channel  Dominance 

Buffer  loading  by  e a c h  subscriber  terminated  to  a 
packet  node  can  be  measured  by  summinq  across  a  matrix  row. 
This  reflects  the  total  buffer  load  by  a  single  subscriber 
on  several  slots. 

Each  matrix  column  represents  the  packet  wa5ting  load 
for  a  given  channel.  If  the  channel  loading  exceeds  a 
prescribed  level,  the  channel  can  be  either  upgraded  by 
establishing  a  new  connection  using  more  slots,  or  the  load 
reduced  by  discarding  packets. 


6.2.3  Window  Ring 

The  inner  strategy  ring  exists  within  the  subscriber 
environment  and  requires  an  intelligent  mechanism  for 
subscriber-subscriber  operational  control.  This  device  must 
be  capable  of  executing  the  window  strategy  algorithm  for 
multiple  connections.  Paramount  for  strategy  ring  interplay 
is  the  assumption  of  four  well  defined  window  properties 
[2,  5,  29]: 

(1)  Source/destination  subscribers  efficiently  utilize 
bandwidth  by  "pushing"  or  " s 1 ow i ng- down "  each 
other . 

(2)  In  coordination  with  nodal  strategy  rings,  any 
discarded  packets  are  detected  by  the  source  and 
ret ra nsmi ss i on  controls  effected. 

(3)  Source/destination  subscribers  can  initiate 
transactions  without  prior  buffer  commitment 

(4)  Physical  end-to-end  controls  become  practical. 

6.3  Ring  Scheme  Implementation 

Implementation  of  the  ring  scheme  hierarchy  can  be 
accomplished  by  instituting  nodal  and  subscriber  software 
controls,  and  the  aforementioned  window  properties.  Software 
controls  consist  of: 

(a)  Nodal  Limit  Variables 

(b)  Global  Monopoly  Matrix 
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6.3.1  Nodal  Limit  Variables 

Nodal  limits  for  each  packet  node  can  be  determined  and 
implemented  by  two  variables  a  t  each  node,  f.URl  OP  and  10PLIM. 
When  the  current  oacket  load  exceeds  the  preset  value  in 
LODLIM,  all  incoming  packets  are  discarded  until  CURLOD  is 
reduced  to  an  acceptable  level.  Property  two  of  the  window 
rinq  strategy  will  detect  this  condition  and  effect  trans¬ 
mission  control s  . 

6.3.2  Global  Monoooly  Matrix 

The  nodal  monopoly  rinq  can  be  implemented  through  use 
of  a  olobal  matrix  which  relates  Class  II  subscribers  (rows) 
and  channels  (columns)  (Fig.  11).  Nodal  termination  of  four 
subscriber  types,  (video,  bulk,  messaoe,  and  interactive) 
can  be  simulated  by  varying  time  slot  allocations  for  each 
type . 

6.4  Subscriber  Window  Development 

The  window  strategy  ring  is  a  combination  of  software/ 
hardware  techniques  implemented  within  the  subscriber 
environment.  As  such,  it  does  not  directly  impact  the  model, 
but  its  structural  caoabilities  must  be  described.  The 
control  mechanism  must  be  an  intelligent  device  consisting 
of  typical  processor  elements  (CPU,  Arithmetic  Logic 
Unit,  memory,  etc.),  and  two  significant  Input/Output  (I/O) 
capabilities: 

(a)  Multiple  Interrupt  Level  Capability 


(b)  Variable  I/O  Data  Rate  Terminations 

6.4.1  Multiple  Interrupt  Level  Capability 

Multiple  subscriber  connections  can  be  expected.  The 
controller  must  be  able  to  transfer  control  to  several  types 
and  levels  of  I/O  interrupt  handlers  (video  to  facsimile, 
message  to  facsimile,  subscriber  transaction  x  to  subscriber 
data  conversion  routine  y,  etc.). 

6.4.2  Variable  I/O  Data  Rate  Terminations 

To  reduce  the  frequency  of  interrupts  associated  with 
terminations  of  multiple  hiqh  speed  connections,  a  Direct 
Memory  Access  (DMA)  capability  must  exist.  This  insures 
that  interrupts  are  properly  serviced  in  an  orderly  manner, 
guards  against  data  overrun,  and  provides  the  facility  for 
terminating  variable  speed  connections  with  minimal  processor 
overhead . 

6.5  Subscriber  Software  Development 

The  software  requirements  for  window  strategy  implemen¬ 
tation  consist  of  those  system  modules  necessary  to  implement 
the  window  strategy  algorithm,  establish  coordination  with 
the  host  node,  and  user  modules  that  pertain  to  subscriber- 
subscriber  communication. 
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CHAPTER  VII 

ANALYSIS  Of  NETWORK  BEHAVIOR 
7.  Network  Configuration 

The  simulator  was  designed  to  accommodate  network 
configurations  with  variable  node  and  channel  arrangements. 
Because  of  the  numerous  system  parameters,  the  simulator  can 
generate  empirical  data  involving  multiple  flow  relationships 
between  arrival  patterns,  nodal  configurations,  integration 
methodology.  Voice  Digitization  Rates,  and  data/ voice  time 
slot  ratios.  The  10-node  network  (Fig.  12)  configured  for 
this  research  addresses  these  complex  issues.  It  provides 
substantial  channel  capacity  for  in-depth  flow  analysis 
without  having  to  resort  to  a  dedicated  computer  facility 
and  corresponding  cost.  The  specific  purpose  of  this 
configuration  was  to  demonstrate  the  practicality  of  an 
integrated  network  based  on  an  underlying  circuit  switch 
subnet. 

7.1  Examination  of  the  Simulator 

The  following  user  input  parameters  and  specifications 
define  the  baseline  performance  criteria  for  a  given  simula¬ 
tion  run: 

( 1 )  Number  of  Nodes 

(2)  Number  of  Links 

(3)  Number  of  Time  Slots 


( 4 )  Slot  Time 

(  S  )  Cross  Office  S  i  <|n«i  I  I  i  ng  Delay 

(6)  Voice  and  Data  Arrival  Rates 

(7)  Simulation  Start  and  End  Time 

(8)  Steady-State  Criteria 

(9)  Voice  Digitization  Rate 

(10)  Allocation  of  Data  Transaction  Storage 

(11)  Service  Rates  for  Voice  and  Data 

(12)  Number  of  Packets  Per  Messaqe 

In  addition,  each  physically  different  network  configuration 
must  be  coordinated  with  corresponding  channel  and  queue 
storage  requirements.  The  simulator  requires  user  specifi¬ 
cation  of  each  network  configuration  through  input  table 
initialization  to  DESTAB,  DSTALT ,  NODCHL,  and  SEEDTB .  DESTAB 
and  DSTALT  tables  contain  the  user  defined  primary  and 
alternate  routing  paths  for  each  sou rce/ des t i n a t i on  pair. 

The  order  of  node/channel  connectivity  is  placed  in  NODCHL. 
SEEDTB  contains  user  specified  seeds  for  each  node.  These 
seeds  are  used  by  the  random  number  qenerator.  A  description 
of  the  input  table  initialization  entries  is  contained  in 
Fiqs.  13  and  14. 

7.1.2  Confidence  in  the  Simulator 

The  Poisson  and  geometric  generators  used  in  the 
simulator  are  based  on  the  combined  research  of  Jackson  and 
Kleinrock  for  assuming  Poisson  arrivals  and  exponential 
service,  and  geometric  distribution  of  data  transactions  for 
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Fig.  14.  Input  parameters  and  specifications  for  10-node 
network 
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where  Card  1  =  PARAM  entries 

Cards  2-11  =  SEEDTB  entries 
Cards  12-21  =  DESTAB  entries 
Cards  22-31  =  DSTALT  entries 


Card  32  =  NODCHL  entries 
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modelinq  networks  [38,  49].  The  random  number  generator  is 
a  commonly  accepted  pseudo- random  number  generator  [59]  that 
generates  a  uniformly  distributed  random  variable  between  0 
and  1.  The  arrival  and  service  process  of  external  customers 

« 

at  each  node  is  assumed  independent  of  the  movement  of  link 
customers  and  independent  from  node  to  node.  Although  this 
is  not  true  because  service  time  is  based  on  the  length  of 
the  message,  the  assumption  can  be  assumed  reasonable  using 
Kleinrock's  independence  assumption  [49J. 

Network  simulator  performance  was  validated  by 
establishing  voice/data  confidence  intervals  on  system 
output  transactions  [22,  91J.  True  data/voice  means  were 
determined  by  the  use  of  standard  Poisson  generators,  and 
user  run  time  specifications.  Confidence  intervals  on 
data/voice  output  nodal  observations  were  used  to  establish 
that  the  simulator  was  performing  within  a  95%  level.  Upper 
and  lower  confidence  bounds  were  placed  around  two  distinct 
arrival  patterns,  assuming  a  normal  distribution,  and  the 
student  t  (since  the  sample  size  was  less  than  30).  Table  II 
shows  that  the  simulator  is  behaving  within  a  95%  data/voice 
confidence  interval. 

Additional  verification  of  simulator  output  was 
obtained  by  configuring  the  simulator  to  correspond  to  the 
*  analytic  model  and  comparing  the  output  results.  Using  a 

common  arrival  pattern,  the  number  of  Class  I / 1 1  transactions 
were  closely  correlated  as  follows: 


Table  II.  Calculation  of  Confidence  Intervals 


Confidence  Interval  Statistic  [91] 

X  +  tcrit/  S 

where  t  =  sample  size 

s  =  sample  standard  deviation 

N  =  sampl e  size 

+  =  ^crit  =  critical  values  of  t 


Arrival  pattern  one  calculation 


"true" 

system 

observed 

s.ys  tem 

data  = 

3075 

data  =  3093.6 

S1  =  38 

voice 

=  40 

voice  =  41.4 

S2  =  9 

95°/,  confidence  interval  for  data  is  3040  -  31  46 
95%  confidence  interval  for  voice  is  28.8  -  54 

Arrival  pattern  two  calculation 
"true"  system  observed  system 

data  =  18000  data  =  17571.6  S1  =  471 

voice  =  80  voice  =  76.4  S2  =  11 

95/  confidence  interval  for  data  is  16916.7  -  18226.4 
95 %  confidence  interval  for  voice  is  64.29  -  95.707 
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Steady -st ate  comparison 

Analytic  model  Simulator 

Calls  insystem  15  12.8 

Data  transactions  in  system  1  .5 

The  confidence  interval  validation  augmented  by 
analytical  niode  1  /s  i  mu  1  a  tor  correspondence  provided  sufficient 
verification  of  the  program  loqic  and  computer  code. 

7.1.3  P-  c.’iption  of  Simulator  Output 

Output  from  the  simulator  consists  of  (1)  individual 
channel  information  relating  the  number  of  data  and  voice 
transactions  over  that  channel  with  corresponding  utiliza¬ 
tion,  (2)  packet  node  statistics  to  include  packet  delays, 
current  and  cumulative  loading  by  node  and  source/destination 
pairs,  and  (3)  circuit  node  voice  information  relating  the 
number  in  the  system,  blocking,  and  total  calls.  Appendix 
0  contains  the  output  for  a  typical  simulation  run. 

7.2  Analysis  of  Network  flow 

The  sources  of  relevant  parameters  and  assumptions  for 
the  10-node  network  were  evaluated  as  follows: 

1.  The  frame  interval  was  10  milliseconds.  This  was 
consistent  with  several  related  simulations  [10,  18, 
36,  60,  83]. 

2.  Packet  and  circuit  switches  had  common  user-to- 


network  call  r e t -u p/ d i s conne c t  procedures  with  a 
60  milliseconds  cross-office  time  and  a  32  Kb/sec 


CCIS  rate.  This  CCIS  rate  represents  a  capability 
of  new  generation  LSI  digital  switches  [60,  79,  84], 
3.  A  competitive  frame  management  design  was  implemen¬ 
ted  because  it  offers  greater  potential  for 
efficient  use  of  the  T1  link  over  a  wide  range  of 
traffic  flow  [21,  60,  83,  87], 

From  Figs.  15-20  and  tables  in  Appendix  E,  the  impact 
on  flow  behavior  using  different  arrival  patterns  can  be 
observed.  High  voice  rates  (20/min),  independent  of  data 
flow  dominate  the  channels,  resulting  in  high  packet  delays, 
blocking,  and  channel  utilization.  Low  voice  rates 
(5-1 5/mi n )  and  moderate  packet  flow  (  500/sec)  result  in  low 
blocking,  delays,  and  channel  utilization.  Within  these 
ranges,  a  system  can  be  designed  for  this  network  that 
supports  moderate  voice  and  data  activity.  In  essence,  the 
basis  for  grade-of-service  (channel  utilization,  delay, 
throughput)  can  be  established  by  network  tuning  with  the 
simulator. 

7.3  Analysis  of  Analytic  Output 

The  need  for  analyzing  network  behavior  in  computer- 
communications  networks  has  spurred  the  development  of 
network  simulators  because  the  numerous  variables  preclude 
precise  analytic  solution.  Decomposition-synthesis,  however, 
is  an  analytic  approach  that  has  been  used  to  reduce 


simulation  costs. 


arrival  rate  ( t ra ns ac t i o ns/ s ec  ) 


Arrival  pattern 

Class  II 


as 

shown 


7.3.1  Decomposition-Synthesis  Aporoach 

Using  this  approach,  a  network  is  decomposed  into  nodal 
configurations.  The  results  obtained  are  synthesized  to 
form  a  composite  solution.  Justification  for  this  approach 
has  been  provided  by  Jackson  [38],  and  is  based  on  standard 
Markovian  assumptions  of  independently  exponentially 
distributed  arrival  and  service  times  in  a  system  that  is 
assumed  to  be  stable.  For  the  integrated  environment  this 
aporoach  was  employed.  Computer  implementation  of  the  analy¬ 
tic  model  can  be  used  to  derive  important  steady-state 
measures  at  each  node. 

7.3.2  Utility  of  the  Analytic  Model 

An  integrated  network  based  on  an  underlying  circuit 
switched  subnet  has  not  yet  been  implemented.  Analytic  tools 
that  have  been  used  to  parameterize  an  integrated  network 
are  still  in  their  infancy.  The  most  authoritative  work  to 
date  has  been  done  by  Fischer  [21],  who  treats  the  network 
as  a  queueing  problem.  He  proposes  a  solution  technique 
involving  generating  functions,  a  queueing  "gate",  and 
variably  integrated  frame  methodology  to  analyze  network 
b  e  h  a  v  i  o  r  . 

The  analytic  model  prooosed  in  this  research  uses  a 
rate  matrix  and  linear  matrix  concents  to  permit  tractable 
examination  of  steady -  state  relationships  between  voice  and 
data  traffic  flow.  The  software  implementation  of  the 
analytic  model  is  written  in  (OUTRAN  and  highly  portable. 
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The  user  specifies  arrival  and  service  rates,  and  channel 
size  from  input  parameters.  The  use  of  a  steady-state 
variable  ( ML  I  MI T )  allows  the  user  to  determ ine  steady -state 
by  noting  changes  to  effectiveness  measures  before  and  after 
MLIMIT  adjustments. 

As  with  all  analytic  network  tools,  it  does  have 
limitations.  Firstly,  the  model  is  formulated  using  a  one 
to  one  time  slot  correspondence  between  voice  and  data.  If 
this  correspondence  is  altered,  meaningful  output  can  be 
obtained  by  adjusting  arrival  and  service  rates  to  corres¬ 
pond  to  the  new  slot  relationship.  Secondly,  double 
precision  accuracy  is  required  for  two  reasons: 

(1)  The  iterative  calculation  of  matrices  ,  .... 
Gc]  for  large  channel  (C)  sizes  results  in 
considerable  loss  of  precision. 

(2)  The  eigenvalues  used  in  the  computation  of  B=RJS 
are  small  and  close  in  magnitude. 

Finally,  software  implementation  of  the  model  requires  four 
matrices  dimensioned  (2C+2)  *  (2C+2)  and  several  (C+l)  * 

( C+ 1 )  matrices. 

In  summary,  the  need  for  double  precision  accuracy  and 
potentially  large  matrices  may  demand  considerable  CPU 
resources  (one  megabyte  upwards).  Appendix  C  contains 
steady-state  output  for  various  channel  sizes. 

7 . 4  Summa  ry 

The  simulation  and  analytic  models  are  useful  tools  for 
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studying  network  behavi  r.  Software  implementations  of  these 
models  can  be  used  jointly  to  characterize  traffic  behavior 
in  an  integrated  environment.  Analysis  of  the  10-node 
configuration  indicates  that  an  integrated  computer- 
communications  network  based  on  an  underlying  circuit  switch 

» 

subnet  is  feasible  within  a  range  of  traffic  flow. 


CHAPTER  VIII 


CONCLUSIONS  ANO  RECOMMENDATIONS 

!i .  Conclusions 

The  primary  objective  of  this  research  was  to  oesign  an 
intenrated  network  and  to  analyze  the  traffic  behavior. 

Initial  investigation  was  dpvoted  to  a  review  of  flow 
cortrols  in  existing  store-and- forward  and  circuit  switched 
networks.  As  a  result  of  this  review,  prominent  flow  control 
strategies  were  c.tegorized  as  subnet  or  subscriber  control¬ 
ling.  Tl,is  classification  provided  a  framework  for  potential 
network  regulating  techniques  in  an  integrated  environment. 

Next,  it  was  necessary  to  develop  a  simulation  model 
that  characterized  network  behavior.  The  developed  model 
and  its  implementation  is  based  on  common  call  management 
and  traffic  inteoration  on  trunk  lines  using  an  underlying 
circuit  switch  subnet.  It  provides  substantial  flexib  lity 
tor  ’ n ter- re  1  at i ng  numerous  network  design  features  and 
parameters.  The  resulting  empirical  data  permits  in-depth 
analysis  of  several  network  problem  areas. 

Another  significant  goal  of  this  research  was  the 
formulation  and  computer  implementation  of  an  analytic  tool 
tnat  can  be  used  to  derive  system  effectiveness  measures. 

Analysis  of  summary  information  from  the  10-node  model 
demons tra ted  that  a  circuit  switched  integrated  network  was 
practical  within  a  range  of  data/voice  transaction  flow.  A 


need  for  positive  flow  controls  was  also  established.  Using 
the  flow  control  classification  framework,  a  rina  control 
hierarchy  was  proposed.  This  hierarchy  manages  controls  in 
th-'  two  major  areas  of  concern  -  nodal  overloading  and 
subscriber  dominance.  Although  the  hierarchy  was  not 
i rp 1  emeu  ted ,  an  implementation  scheme  was  proposed. 

.  1  '•  ecommenda  t  ions 

Cecause  of  the  increased  channel  capacities  and  speeds 
in  an  integrated  network,  considerable  resources  must  be 
e> pended  io  collect  simulated  statistics.  This  research  has 
shown  that  dedii  iced  resources  are  extremely  necessary  for 
in-depth  modeling  and  analysis  of  various  network  configura¬ 
tions. 

Tin?  i  ntegrc  t  ior  methodology  used  in  tr.e  mode  1  does  not 
incorporate  a  priority  or  preemption  capability.  The  design 
of  slot  allocations  should  be  researched  to  include 
priorities  of  subscriber  traffic  and  probable  system 
saturation  condi tions  . 

A  rinq  flow  control  hierarchy  or  related  management 
control  mechanism  is  necessary,  and  such  an  implementation 
is  recommended. 

The  interspersing  of  sub-classes  of  data  traffic  to 
voice  slots  needs  to  be  investigated. 

With  the  aid  of  the  network  simulator  and  analytic 
model,  further  research  into  the  numerous  network  design 
features  arid  parameter  inter-relationships  needs  to  be 


conduc  ted  . 


Configuration  of  the  network  topology  (nodes,  links, 
connectivity,  p ri ma ry/ a  1 te rna te  routing  paths,  etc.)  must 
be  manually  accomplished.  Development  of  an  automated 
pre-processor  is  highly  recommended  to  facilitate  implemen¬ 
tation  of  various  network  topologies. 

Although  not  specifically  addressed  in  this  disserta¬ 
tion,  the  following  related  issues  impact  network  design 
and  require  investigation: 


1 . 

Voice  multiplexing  of  time 

slots 

2. 

Development  of  an  optimal 

routing  scheme 

3  . 

Design  of  system  timing 

4  . 

Nodal  packet  queue  management 

5. 

Nodal  design 

6. 

Network  flow  control 
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APPENDIX  A 


Appendix  A  contains  a  description  of  simulator  tables, 
users  guide,  and  a  listing  of  the  network  simulator  program 
used  in  this  research.  Each  table  is  defined  and  its  layout 
described.  The  users  guide  details  the  parameters  and  table 
building  requirements.  Since  the  program  is  written  in 
FORTRAN,  and  the  modules  designed  to  be  s e 1 f - doc umen t i ng , 
a  user  should  have  minimal  difficulty  using  or  modifying 


the  simulator. 


1 .  Users  guide 


The  size  of  the  COMMON  area  determines  the  storage 
regu  i  re  men  t.s  for-  the  network  to  be  simulated.  (here  are  no 
simulator  error  controls  governing  network  configuration  or 
size.  The  user  has  the  flexibility  of  configuring  a  network 
topology  and  adjusting  COMMON  storage  accordingly. 

Each  input  parameter  is  contained  in  a  PARAM  table  entry 
a.  Description  of  Input  Parameters 

(1)  Contains  the  total  number  of  packet  and 
ci rcui t  swi tch  nodes . 

(2)  Establishes  the  total  number  of  HDX  links  in 
the  network. 

(3)  Contains  the  number  of  time  slots  per  HDX  link. 

(4)  Determines  the  number  of  slots  in  each  frame 
which  a  data  packet  reguires. 

(5)  A  constant  which  establishes  the  number  of 
frames  per  second  and  service  rate  for  data. 

(6)  A  constant  which  permits  the  user  to  establish 
the  switching  delay  through  each  circuit  switch 

(7)  Contains  the  voice  transaction  arrival  rate. 

(8)  Contains  the  data  transaction  arrival  rate. 

(9)  Holds  the  user  specified  start  run  time. 

(10)  Holds  the  user  specified  end  run  time. 

(11)  This  parameter  is  a  saturation  level  indicator. 
When  the  generation  (if  packets  exceeds  this 
threshold,  channel  arid  queue  table  entries 
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are  zeroed  out..  Use  of  this  pa  r a me  ter  is  in 
conjunction  with  steady-state  determination. 

(12)  Establishes  how  many  bits  comprise  a  time  slot. 
It  is  used  in  conjunction  with  PARAM  entries 
two  through  four  to  determine  the  data  depart- 

u  re  rate. 

(13)  Information  only  -  it  is  the  capacity  of  the 
T  link. 

(14)  Contains  the  service  rate  for  voice  transac- 
t  i  o  n  s  . 

(15)  Establishes  the  average  number  of  packets  per 
data  transaction.  It  is  used  by  the  geometric 
generation  process. 

(16)  Information  only  -  it  indicates  how  many  bits 
per  packet. 

(17)  A  dynamic  time  indicator  used  by  the  simulator 
when  queue  storage  is  exceeded.  From  this 
entry,  the  user  knows  how  far  the  simulation 
progressed  before  storage  was  exceeded. 

b.  lable  building  specification 

The  user  must  initialize  DESTAB,  DSTALT,  NODCHL,  and 
SEEDTB.  The  formats  and  order  of  input  can  be 
determined  from  the  program  listing  and  Fig.  13. 

2.  Common  Variables  in  the  Program 

All  tables  are  contained  in  COMMON  storage.  Tables 


1 


A2-1  through  A 2-16  are  necessary  to  integrate  the  functional 
modules.  Each  table  contains  a  description  of  its  use  and 
composition. 


3.  Listing  of  the  Simulator 


Table  A2-2.  Event  (EVTBL)  [Node,  Entry] 


This  table  maintains  a  record  of  the  next  event 
occurrence  at  each  node.  The  [Node,  Entry]  table  entries 
a  re  : 


1  2  3  4  5 


En  t  r^y 

Definition 

(1  ) 

T  i  me 

( mi  1 1 i seconds  ) 

(2) 

Type 

1 ,  2,  3, 

4 

1  =  Class 

II  a  rr i va 1 

2  =  Class 

II  departure 

3  Class 

I  arrival 

4  -  Class 

I  departure 

(  3) 

Me  s  s  a  <ie  length 

(  4) 

I  i  ria  1 

<!<•  s  t  i  n  a  l 

i  on 

(  5) 

Queue 

address 

Table  A2-3.  Destination  (DESTAB)  [Node,  Dest] 

This  table  contains  the  primary  channels  between  all 
node  pairs  [Node,  Dest]  and  zeroes  elsewhere.  If  the  source 
node  is  a  packet  node,  the  [Node,  Dest]  entry  contains  the 
directly  connected  circuit  switch  node  vice  primary  channel. 

1  2  3  4  5  6...  PARAM  ( 1  ) 


1 


f 


I 


f 


Table  A2-4.  Channel  Table  (CHANTB)  [Channel,  Entry’ 

There  is  one  channel  table  per  HDX  link  between  circuit 
switch  nodes.  Each  channel  table  contains  PAPAM  (3)  rows. 


1 

2 

3 

4 

5 

6 

7 

8 

9 

10 

1 1 

1 

l.L 

2 

1 

3 

- -  - 

h 

PARAM  (3) 

Entry 
(1  ) 
(2) 

(3) 

(4) 

(5) 

(6) 

(7) 

(8) 
(9) 

(10) 
(ID 


D  e  f  i  n  i_t  j  o  n 
Final  destination 
Time  channel  active 
Time  channel  available 
Number  of  voice  channels  for  this 
transaction 

Destination  number  of  intermediate  node 

Cumulative  time  channel  in  use 

Source  node  for  this  transaction 

Queue  address 

Cumulative  transactions 

Cumulative  packets 

Cumulative  voice  calls 


1  30 


T  .1  b  I  (>  A?  -  5  Queue  ( f)UE  Ul  )  [Node,  Entry]  -j 

•  I 

Each  queue  table  entry  pertains  to  a  packet  group  I 

a r r i v a  1  at  this  node.  This  table  only  exists  for  packet  -  | 

switch  nodes.  The  number  of  entries  is  specified  by  the  : f 

i 

i 

user  in  the  COMMON  area. 


1  2  3  4  5 


E  n  trj( 

Definition 

(1) 

Priority 

(2) 

Arrival  time 

(3) 

Departure  time 

(4) 

Message  length 

(&) 

final  destination 

i 


Table  A2 -  7  .  Cumulative  Time  {  CUMT  I N! )  [Node,  Entry] 

This  table  maintains  a  running  count  of  packet  delays 
in  seconds  at  all  packet  switches. 


3  4  5  6 


8  9  10  11  12 


PARAM  ( 1 )/2 


Entry  Definition 


(1) 

.1  sec 

(2) 

<  .2  sec 

(3) 

«-  .3  sec 

(4) 

<  .4  sec 

(5) 

•  .5  sec 

(6) 

■  .6  sec 

(7) 

.7  sec 

(«) 

.8  sec 

(9) 

.9  sec 

(10) 

••  1  sec 

(11) 

2  sec 

(12) 

•  6  sec 

(13) 

5  sec 

Table  A2-9,  Link  (LINKTB)  [Node,  Dest] 


This  is  a  dynamic  working  table  containing  a  channel 
address  pointer  for  each  active  node  destination  connection. 
This  pointer  is  necessary  to  reduce  table  look-ups.  Diagonal 
elements  are  unused  and  set  to  zero. 


12  3...  PARAM  ( 1  ) 


Table  A2- 

T  h  i  s 

arrival  a 

t 

rate  ,  and 

41 

z  a  t ion  f  r 

the  s i mu  1 

s. 

1 

2 

\ 

,1 

1 

l 

1 

1 

1 

3 

En_t  ry 

(T 
(2 
(3 


4 


D  e  f  i  n  i  t  i  o  n 

Seed  1  -  arrival 

Seed  2  -  departure 

Seed  3  -  geometric  message  length 


Seed  4 


destination 


Table  A?- 11  .  Link  Availability  (NL1NLS)  [Channel] 


This  table  is  a  working  table  that  maintains  a  running 
count  of  available  slots  for  each  channel. 


1 

PARAM  (3) 

1 

2 

3 

PARAM  (2) 

Table  A  2  -  1  3  .  Channel  Connectivity  (NODCHL )  [link] 


This  table  is  built  durinf)  initialization  by  inputted 
system  parameters.  It  contains  the  intermediate  node  to 
which  each  HDX  link  is  connected. 


Table  A2-14.  Alternate  Channel  (ALTCH)  [Channel] 

This  table  is  a  working  table  which  reflects  which 
channel  (primary/alternate)  to  use  to  route  this  trans¬ 


action. 


Table  A2-16.  Alternate  Destination  (DSTALT)  [Node,  Dest] 


This  table  contains  the  alternate  channels  between  all 
node  pairs  [Node,  Dest].  Diagonal  elements  are  set  to  zero 
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APPENDIX  B 

Appendix  B  contains  a  users  guide  and  listing  of  the 
analytic  model.  The  program  is  written  in  FORTRAN  and  highly 
portable.  The  program  documentation  correlates  very  closely 
to  the  analytic  development. 
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1 .  Users  guide 

a.  Description  of  Input  Parameters 

(1)  LAMDA1  -  contains  data  transaction  arrival  rate 
per  minute. 

(2)  LAMDA2  -  contains  voice  transaction  arrival 
rate  per  minute. 

(3)  MU1  -  contains  data  transaction  service  rate 
per  minute. 

(4)  MU2  -  contains  voice  transaction  service  rate 
per  minute. 

(5)  NSIOTS  -  establishes  the  channel  state-space 
size. 

(6)  MLTMIT  -  establishes  a  user  specified  steady- 
state  indicator.  It  must  be  equal  or  greater 
than  NSLOTS. 

b.  Pun-Time  Considerations 

Because  the  model  uses  large  matrices,  double 
precision  accuracy,  and  is  compute  bound,  it  requires 
considerable  CPU  resources.  For  use  on  the  Texas 
ASM  Amdahl  computer  facility,  an  NSLOTS  of  48 
reauired  one  megabyte  and  SO  seconds  of  CPU  time. 

To  keep  costs  to  a  minimum,  the  program  must  be  run 
during  level  0  operation. 


2.  Listing  of  the  program 
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CIRCUIT  SWITCH  NODE  STATISTIC 


APPENDIX  E 

The  data  contained  in  Appendix  E  supports  the  graphical 
presentations  shown  in  Chapter  VII.  Each  table  contains 
)  summary  information  of  network  behavior  for  a  specified 

arrival  pattern.  Headings  and  titles  make  each  table 
self  explanatory. 


( 


Table  El.  Arrival  Pattern  1 


a  i  =  5  0  /  s  e  c 


A  2  =  5 / mi  n 


Link  Usage 


Link 


Throughput 


Utilization 


1 

38874 

.18 

2 

56391 

.29 

3 

43905 

.23 

4 

55470 

.  39 

5 

39195 

.29 

6 

21405 

.13 

7 

55293 

.29 

8 

38283 

.  1  7 

9 

55429 

.37 

10 

55308 

.33 

11 

34686 

.23 

12 

40902 

.27 

Avg 

44595 

.26 

Packet 

Node  Summary 

Node 

Packet 

Delay  (Sec) 

Data 

in  System 

1 

.10 

1 

L 

.10 

1 

3 

.10 

1 

4 

.10 

2 

5 

.10 

1 

Avg 

.10 

1.2 

Circuit 

Node  Summary 

Node 

Total  Calls 

Blocking 

Calls 

in  System 

6 

43 

0.0 

14 

7 

52 

0.0 

18 

8 

44 

0.0 

12 

9 

27 

0.0 

10 

10 

41 

0.0 

10 

Avg 


41  .4 


0.0 


12.8 
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Table  T2.  Arrival  Pattern  2 


x i  =  200/sec 


x 2  =  5/mi n 


Link  Usage 


Link 

Th  rouqhput 

Utilization 

1 

1 50564 

.26 

2 

227247 

.  41 

3 

1  73043 

.32 

4 

215493 

.51 

5 

141996 

.  36 

6 

7943  1 

.  1  7 

7 

230826 

.41 

8 

161001 

.26 

9 

215424 

.  50 

10 

216744 

.45 

1 1 

138147 

.  30 

12 

1  52466 

.35 

A  vg 

1 75198 

.35 

Packet 

Node  Summary 

Node 

Packet 

Delay  (Sec) 

Data 

in  System 

1 

.10 

5 

2 

.10 

3 

3 

.10 

3 

4 

.10 

4 

5 

.10 

2 

A  vg 

.10 

3.4 

C  i  r  c  u  i  t 

Node  Summary 

Node 

Total  Calls 

B 1 oc  k i nq 

Calls 

in  System 

6 

43 

0.0 

14 

7 

52 

0.0 

1  8 

8 

44 

0.0 

12 

9 

27 

0.0 

10 

10 

41 

0  .0 

10 

A  vg 

41  .  4 

0.0 

PO 

CD 

Table  E3.  Arrival  Pattern  3 


350/sec 


Link  Usage 

T  h  r  o  u^g  h  p  u  t 

Utilization 

256002 

.35 

393978 

.  54 

299781 

.42 

363798 

.63 

251445 

.44 

149385 

.23 

409920 

.53 

283980 

.  35 

374978 

.  56 

367775 

.62 

242091 

.  38 

276579 

.43 

305809 


Packet  Node  Summary 
Packet  Delay  ( Sec ) 


D  a  t  a  in 


Circuit  Node  Summary 

TotalCalls  Blocking  Calls^  i_n  System 


.0 


244 


Table  E4.  Arrival  Pattern  4 


A 1  =  500/sec  x ^  =  5  min 


Link  Usage 

Link 

Throughput 

Util i z  a  t i o  n 

1 

384150 

.44 

2 

5741 94 

.67 

3 

418002 

.49 

4 

492114 

.71 

5 

370248 

.52 

6 

243537 

.31 

7 

590823 

.67 

8 

410283 

.44 

9 

503589 

.71 

10 

532458 

.68 

1  1 

390666 

.49 

12 

397665 

.  52 

Avg 

442310 

.55 

Packet  Node  Summery 

Node 

Packet  Delay  (Sec) 

Data  in  System 

1 

.15 

16.5 

2 

.14 

5.2 

3 

.18 

12.9 

4 

.21 

13.1 

5 

.  21 

11.2 

Avg 

.18 

11.8 

Circuit  Node  Summary 


Node  Total  Calls  Blocking  Calls  in  System 


6 

43 

0.00 

1  4 

7 

52 

0.00 

18 

8 

44 

0.02 

11 

9 

27 

0.00 

10 

10 

41 

0.02 

10 

Avg 


41  .4 


0.008 


12.6 
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Table  L5.  Arrival  Pattern  5 


\ 1  =  100/sec  *2  =  10/min 


Link  Usage 

Link 

Throughput 

Utilization 

1 

73113 

.39 

2 

1  20975 

.  59 

3 

88866 

.49 

4 

85230 

.74 

5 

74499 

.57 

6 

6461  1 

.  32 

7 

1  30344 

.61 

8 

83940 

.41 

9 

95529 

.  71 

1  0 

99321 

.65 

1 1 

73686 

.46 

1  2 

82041 

.52 

Avg 

89346 

.53 

Packet  Node  Summary 

Node 

Packet  Delay  (Sec) 

Data  in  System 

1 

.18 

6 

2 

.14 

3 

3 

.13 

6 

4 

.19 

5 

5 

.23 

5 

Avg 

.  1  7 

5.0 

Circuit  Node  Summary 

Node 

Total 

Calls  Blocking 

Calls  In  System 

6 

72 

0.0 

30 

7 

89 

0.0 

25 

8 

86 

0.0 

38 

9 

61 

0.0 

27 

10 

74 

0.0 

14 

Avg  76.4  0.0 


26.8 


246 


Table  E6 .  Arrival  Pattern  6 


a^  =  200/sec 


>  2  =  1  0  /  m  i  n 


4 


/ 


Link  Usage 

Link 

Throughput 

Utilization 

1 

163716 

.45 

2 

251625 

.68 

3 

175707 

.55 

4 

165300 

.78 

5 

141675 

.61 

6 

1 29624 

.39 

7 

251 550 

.69 

8 

1 72224 

.46 

9 

175611 

.  76 

10 

203487 

.72 

1 1 

175125 

.54 

12 

164157 

.57 

Avg 

180816 

.60 

Packet  Node  Summary 

Node 

Packet  Delay  (Sec) 

Data  in  System 

1 

.22 

14.1 

2 

.15 

8.7 

3 

.29 

16.0 

4 

.29 

11.7 

5 

.35 

15.2 

Avg 

.26 

13.1 

Circuit  Node  Summary 

Node 

Total  Calls  Blocking 

Calls  in  System 

6 

72  0.03 

27 

7 

89  0.00 

27 

8 

86  0.02 

37 

9 

61  0.02 

26 

10 

74  0.00 

12 

Avg 

76.4  0.01 

25.8 

247 


Table  E7.  Arrival  Pattern  7 


A1 

=  300/sec  X,,  = 

1  0  /  m  i  n 

Link  Usage 

Link 

Throughput 

Utilization 

1 

245532 

.59 

2 

333993 

.78 

3 

258927 

.61 

4 

271506 

.79 

5 

226833 

.67 

6 

1 79883 

.49 

7 

358662 

.77 

8 

286050 

.57 

9 

302925 

.  77 

1  0 

330669 

.77 

1 1 

252708 

.66 

1  2 

252672 

.66 

Avg 

275030 

.68 

Packet  Node  Summary 

Node 

Packet  Delay  (Sec) 

Data  in  System 

1 

.45 

25.4 

2 

.26 

17.3 

3 

.60 

26.3 

4 

.46 

25.5 

5 

.61 

27.0 

Avg 

.47 

24.3 

Circuit  Node  Summary 

Node 

Total 

Calls  Blocking 

Calls  in  System 

6 

72 

0.00 

24 

7 

89 

0.00 

28 

8 

86 

0.08 

29 

9 

61 

0.05 

25 

10 

74 

0.08 

16 

Avg 

76 

.4  0.04 

24.4 

248 
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Table  E8.  Arrival  Pattern  8 


*1  =  500/sec  A  2  ~  i 0/m in 


Link  Usage 

Link 

1 h  roughput 

Utilization 

1 

521970 

.73 

2 

598008 

.87 

3 

445971 

.73 

4 

402108 

.87 

5 

380637 

.78 

6 

374433 

.63 

7 

544392 

.87 

8 

475761 

.73 

9 

398043 

.88 

10 

513417 

.85 

1 1 

544041 

.76 

12 

473937 

.  78 

Avg 

472726 

.79 

Packet  Node  Summary 

Node 

Packet  Delay  (Sec) 

Data  in  System 

1 

1  .82 

35.0 

2 

1  .48 

32.4 

3 

2.01 

34 . 2 

4 

2.35 

40.5 

5 

2.37 

28.7 

Avg 

2.00 

34.1 

Circuit  Node  Summary 


Node 

Total  Calls 

Blocking 

Calls  in  System 

6 

72 

0.07 

27 

7 

89 

0.06 

19 

8 

86 

0.09 

28 

9 

61 

0.08 

22 

10 

74 

0.16 

11 

Avg 

76.4 

0.09 

21  .4 

( 


n 


Node 

6 

7 

8 
9 

10 

Avg 


249 

Table  E9. 

Arri val  Pattern  9 

^  =  50/sec  >2  = 

I 

1  5/mi n 

Link  Usage 

Link 

Throughput 

Utilization 

1 

49572 

.59 

2 

62040 

.77 

3 

35181 

.  70 

4 

36879 

.84  ' 

5 

29583 

.  75  : 

6 

31167 

.61  ! 

7 

50163 

.79 

8 

35790 

.61  ! 

9 

38484 

.82  1 

10 

46110 

.81 

11 

51849 

.69 

12 

50662 

.  70 

A  vg 

43123 

.72 

Packet  Node  Summary 

Node 

Packet  Delay  ( Sec  ) 

Data  in  System 

1 

1  .85 

51  .6 

2 

2.21 

85.6 

3 

2.69 

79.2 

4 

2.67 

72.0 

5 

2.62 

54.2 

A  vg 

2.40 

68.5 

Circuit  Node  Summary 
Total  Calls  Blocking 


0.10 

0.19 

0.19 

0.20 

0.19 


Calls  in  System 

31 

51 

39 

37 

31 


118.2 


0.17 


37.8 


;.a  .«•*.*  1 


«•* 
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Table  E10.  Arrival  Pattern  10 


A^  =  200/sec  A£  =  15/min 


Link  Usage 


4 


i 


Link 

Throughput 

Utilization 

1 

149400 

.72 

2 

218595 

.85 

3 

135270 

.76 

4 

73443 

.88 

5 

121179 

.80 

6 

158946 

.68 

7 

207996 

.85 

8 

1  56879 

.73 

9 

124815 

.86 

10 

142020 

.86 

11 

195174 

.  78 

1  2 

174612 

.78 

A  vg 

154860 

.79 

Packet  Node  Summary 

Node 

Packet  Delay  (Sec) 

Data  in  System 

1 

2.89 

39.7 

2 

2.73 

89.7 

3 

3.20 

36.2 

4 

2.80 

37.5 

5 

2.87 

86.3 

Avg 

2.89 

•  57.8 

Circuit  Node  Summary 


Node  Total  Calls  Blocking  Calls  in  System 


6 

108 

0.14 

27 

7 

1  37 

0.20 

51 

8 

124 

0.19 

36 

9 

104 

0.27 

30 

10 

118 

0.21 

32 

A  vg 


118.2 


0.20 


35.2 


Table  Ell.  Arrival  Pattern  11 


A  -j  =  350/sec  A  2  =  15/min 


Link  Usage 

Link 

Throughput 

Utilization 

1 

309231 

.79 

2 

358560 

.88 

3 

256956 

.81 

4 

21  4221 

.90 

5 

171807 

.83 

6 

229458 

.  74 

7 

325479 

.88 

8 

291 339 

.80 

9 

285081 

.89 

10 

324252 

.88 

1  1 

337392 

.81 

12 

324237 

.82 

A  vg 

285667 

.83 

Packet  Node  Summary 

Node 

Packet  Delay  (Sec) 

Data  in  System 

1 

3.23 

30.9 

2 

3.16 

15.1 

3 

3.60 

29.8 

4 

3.92 

36.8 

5 

3.31 

40.4 

Avg 

3.44 

30.6 

Node 


Circuit  Node  Summary 
T otal  Calls  Blocking 


Calls  1 n  System 


6 

150 

0.29 

42 

7 

188 

0.44 

49 

8 

173 

0.47 

35 

9 

151 

0.43 

42 

10 

162 

0.47 

22 

A  vg 


164.8 


0.42 


38 


Table  E13.  Arrival  Pattern  13 


A 1  =  200/sec  a 2  -  20/min 


> 


« 


Link  Usage 

Link 

Th  roughput 

Utilization 

1 

137514 

.82 

2 

200823 

.89 

3 

155250 

.83 

4 

65091 

.91 

5 

63375 

.87 

6 

146799 

.79 

7 

216063 

.89 

8 

1 58361 

.82 

9 

131850 

.91 

10 

167364 

.88 

1 1 

171363 

.84 

12 

118095 

.87 

Avg 

144329 

.86 

Packet 

Node  Summary 

Node 

Packet 

Delay  (Sec) 

Data  in  System 

1 

4.39 

49.6 

2 

4.22 

133.3 

3 

4.93 

40  .6 

4 

4.71 

52.9 

5 

4.34 

117.1 

Avg 

4 . 51 

78.7 

Node 

Circuit 

Total  Calls 

Node  Summary 

Blocking 

Calls  in  System 

6 

150 

0 . 38 

44 

7 

188 

0.40 

44 

8 

173 

0.44 

41 

9 

151 

0.50 

24 

10 

162 

0.46 

24 

A  vg 


164,8 


0.43 


35.4 


Table  E 1 4  . 

Arrival  Pattern  14 

A.  =  300/sec 

A,  =  20/min 

Link  Usage 

Throughput 

Utilization 

207393 
303951 
297009 
1  43895 
8601  3 
181269 
354591 
291639 
266826 
316137 
1  9201  2 
131673 


231034 


Packet  Node  Summary 
Packet  Delav  (Sec 


Data  in  System 


1 

2 

3 

4 

5 

4.58 

4.76 

4.68 

4.58 

4.95 

22.3 

61  .2 

33.1 

19.8 

46.8 

9 

4.71 

36.64 

Circuit 

Node  Summary 

de 

Total  Calls 

Blocking 

Calls  in  System 

6 

150 

0.45 

37 

7 

188 

0.43 

42 

8 

173 

0.45 

31 

9 

151 

0.60 

24 

0 

162 

0.48 

30 

9 

164.8 

0.482 

32.8 

255 
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